-- Logs begin at Thu 2022-06-02 12:54:47 UTC, end at Thu 2022-06-02 14:20:36 UTC. -- Jun 02 13:30:57.794761 dv-cinder-826510-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 02 13:30:57.802256 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 2 13:30:57 2022] *** Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: nodename: dv-cinder-826510-6-iscsi Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: machine: x86_64 Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: clock source: unix Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: pcre jit disabled Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: detected number of CPU cores: 4 Jun 02 13:30:57.804254 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: current working directory: / Jun 02 13:30:57.804806 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: detected binary path: /usr/bin/uwsgi-core Jun 02 13:30:57.804806 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: your processes number limit is 47680 Jun 02 13:30:57.804806 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: your memory page size is 4096 bytes Jun 02 13:30:57.804806 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: detected max file descriptor number: 2048 Jun 02 13:30:57.804806 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: lock engine: pthread robust mutexes Jun 02 13:30:57.805554 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: thunder lock: enabled Jun 02 13:30:57.805722 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 02 13:30:57.805861 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 02 13:30:57.851128 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: Python main interpreter initialized at 0x56005c86b9c0 Jun 02 13:30:57.851128 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: python threads support enabled Jun 02 13:30:57.851128 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: your server socket listen backlog is limited to 100 connections Jun 02 13:30:57.851128 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: your mercy for graceful operations on workers is 90 seconds Jun 02 13:30:57.851505 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: mapped 403077 bytes (393 KB) for 2 cores Jun 02 13:30:57.851587 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: *** Operational MODE: preforking *** Jun 02 13:30:57.851820 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: *** uWSGI is running in multiple interpreter mode *** Jun 02 13:30:57.851820 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: spawned uWSGI master process (pid: 80588) Jun 02 13:30:57.852027 dv-cinder-826510-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 02 13:30:57.853131 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: spawned uWSGI worker 1 (pid: 80597, cores: 1) Jun 02 13:30:57.853131 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: spawned uWSGI worker 2 (pid: 80598, cores: 1) Jun 02 13:30:57.853131 dv-cinder-826510-6-iscsi devstack@keystone.service[80588]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 02 13:31:03.646570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:31:03.646570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: from cryptography.utils import int_from_bytes Jun 02 13:31:03.647351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:31:03.647351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: from cryptography.utils import int_from_bytes Jun 02 13:31:03.647783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:31:03.647783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: from cryptography.utils import int_from_bytes Jun 02 13:31:03.647926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 02 13:31:03.647926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: from cryptography.utils import int_from_bytes Jun 02 13:31:03.697370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:31:03.697549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:31:03.697734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] command line args: [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:31:03.697999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:31:03.698084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 02 13:31:03.698164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ================================================================================ {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:31:03.698247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 02 13:31:03.698418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] command line args: [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 02 13:31:03.698503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] admin_token = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.698660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] config_dir = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.698738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 02 13:31:03.698849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.698941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ================================================================================ {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 02 13:31:03.699020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] config_source = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.699099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] admin_token = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.699202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] debug = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.699333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] config_dir = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.699425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.699698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.699698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] config_source = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.699897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] debug = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] list_limit = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.700906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] log_config_append = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] log_dir = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] list_limit = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] log_file = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] log_config_append = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.701924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] log_dir = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] log_file = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.702965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.703940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.704988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.705122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.705267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.705352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] publish_errors = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.705527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.705755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.705832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.705933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] publish_errors = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] standard_threads = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.706900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] standard_threads = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] use_journal = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] use_json = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] use_stderr = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.707930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] use_syslog = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] use_journal = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708274 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] use_json = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.708499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] use_stderr = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] use_syslog = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.708882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 02 13:31:03.708976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.709938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.710890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.711845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.712846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.713984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.714918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.715927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.716978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.717119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.717233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.717347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.717519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.717668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.717784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.717919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.718904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.719900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.720063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.720212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.720325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.720466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.720585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.720738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.720857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.721732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.722433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.722515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.722597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.722671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.722743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.722820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.722820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723408 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723488 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.723932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.724911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.725869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.726980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727439 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.727986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.728958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729346 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.729902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.730971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.731977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.732384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.732514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.732647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.732727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.732891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.732971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] auth.external = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.733932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] auth.password = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] auth.external = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] auth.token = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.734899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] auth.password = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] auth.token = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.735997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] credential.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.736977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.737131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.737208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.737279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.737492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.737570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.738251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.738340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] credential.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.738497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.738586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.738732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.738813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.738987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.739972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.740985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.741947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742423 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.742989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.743953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.744940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.745887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.746972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.747922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.748003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.748165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.748244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.748456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.748595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.748725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.748855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.749962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.750998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.751978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.752101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.752224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.752358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.752358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.752615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.752757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.752884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.753831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.754081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.754208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.754336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.754336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.754618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.754758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.754887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.755913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.756951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.757866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.758922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.759966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.760917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.761867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.762972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.763989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.764963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.765909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.766867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] role.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] role.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.767965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.768046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.768212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.768292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.768481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.768594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.768761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.768905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.769068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.769283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] role.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.769370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.769542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] role.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.769623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.769778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.769858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.770991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.771966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.772106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.772219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.772353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.772496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.772630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.772751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.772879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.773922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.774852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.775959 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.776928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.777969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.778921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.779867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.connection = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.780871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.781969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.connection = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782432 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.782991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.783946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.784100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.784188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.784899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.784991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.785143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.785232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.785387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.785505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.785628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.785709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:31:03.785880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.786122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.786372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.786607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.786851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.787087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 02 13:31:03.787261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 02 13:31:03.815438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.815776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.816011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.816645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.816884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.817114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.824733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.825779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.853773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.854000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.855178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.855414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.908447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.910869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.959874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.960097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.962108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:03.962349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.028141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.028311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.028563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.028783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.028998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.029212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.029472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.029705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.029934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.030154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.030372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.030588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.053451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.053682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.053905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054414 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.054994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.055242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.055457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.055669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.066296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.066777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.078810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.079994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.080120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80597) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.080204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.080346 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80598) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 02 13:31:04.098926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.099125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:31:04.099463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.099663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:31:04.099929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.100020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.100164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:31:04.100247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.100447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.100557 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.100705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.100790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 02 13:31:04.100973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.101324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.101588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.101843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.111939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.112213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.112527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.112990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.113777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.114057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.114328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.114612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.121066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.122807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.124313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.124615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.124894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.125168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.125443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.125817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.126091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.126175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.126366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.126502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.126637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.126730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.126912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.127000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.127179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.127261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.127544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.127816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.128118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.128919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.129203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.129479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.154127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.155820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.156097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.156890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.158601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.158880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.161930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.162205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.162481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.165252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.165530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.165809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.169700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.169984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.173090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.173370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.174433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.174830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.175232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.175515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.175789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.176061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.176329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.176620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.178385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.178783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.179065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.179344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.179618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.179892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.180163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.180451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.195195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.195466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.199445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.199724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.200108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.203765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.204055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.204378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.209046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.209341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.209573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.213173 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.214330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.217956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.218222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.218521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.218809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.219093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.219368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.219644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.224235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.224560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.224848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.225142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.225425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.225704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.239442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.239729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.248351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.248351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.248706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.248706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.248706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.248706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.248952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.249855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.250127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.253241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.253571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.253852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.254136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.254425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.255017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.256813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.257083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.260113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.260391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.260696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.260974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.261264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.267769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.268043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.268318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.268633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.269599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.269883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.270166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.275715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.275997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.276278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.276580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.276862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.277138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.277414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.288775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.291949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.295265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.296460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.296873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.298762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.299039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.299319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.299718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.303516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.305168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.306817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.307091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.307204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.307366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.308833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.311988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.312275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.312581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.312859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.314788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.316941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.320149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.320458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.320742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.321017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.322022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.322306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.322683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.330104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.330387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.330547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80597) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.330770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.330856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.331089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.332034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.332320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.332641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.332918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.333191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.333458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.333722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.333999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.334270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.334540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.334794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80597) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.339725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80598) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 02 13:31:04.340004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.340282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.340584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.340858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.341189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.341464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.341732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.342007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.342275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.342542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.342808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.343080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.343338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80598) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 02 13:31:04.373061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56005c86b9c0 pid: 80597 (default app) Jun 02 13:31:04.376347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1817-246f-4ca1-8f00-7115d83b792f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:04.376664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1817-246f-4ca1-8f00-7115d83b792f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:04.376943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a1817-246f-4ca1-8f00-7115d83b792f None None] PATH_INFO: `/v3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:04.381851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Thu Jun 2 13:31:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:04.383279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x56005c86b9c0 pid: 80598 (default app) Jun 02 13:31:13.524785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf104e-783a-4302-ad26-416d99687b77 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:13.525228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf104e-783a-4302-ad26-416d99687b77 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:13.525361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf104e-783a-4302-ad26-416d99687b77 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:13.526745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:13.534657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:13.535044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:13.535227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:13.602438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: INFO dbcounter [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] Registered counter for database keystone Jun 02 13:31:13.623610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG oslo_db.sqlalchemy.engines [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:31:13.630273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writer thread running {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:31:13.916507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG passlib.handlers.bcrypt [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80598) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:31:13.916832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG passlib.handlers.bcrypt [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80598) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:31:13.972097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:13.973738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:14.097554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1/3] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 02 13:31:14.284367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf104e-783a-4302-ad26-416d99687b77 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:14.354381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: INFO dbcounter [None req-a7bf104e-783a-4302-ad26-416d99687b77 None None] Registered counter for database keystone Jun 02 13:31:14.374479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG oslo_db.sqlalchemy.engines [None req-a7bf104e-783a-4302-ad26-416d99687b77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 02 13:31:14.381888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writer thread running {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 02 13:31:14.608074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf104e-783a-4302-ad26-416d99687b77 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:14.613094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2255ed-4e54-4d98-b4ff-2590714d55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:14.613645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2255ed-4e54-4d98-b4ff-2590714d55c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:14.613939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2255ed-4e54-4d98-b4ff-2590714d55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:14.614220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2255ed-4e54-4d98-b4ff-2590714d55c7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:14.622336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2255ed-4e54-4d98-b4ff-2590714d55c7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:14.673617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1f2255ed-4e54-4d98-b4ff-2590714d55c7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:31:14.673966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2255ed-4e54-4d98-b4ff-2590714d55c7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:14.684057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Jun 2 13:31:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:31:14.690318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:14.704507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e0068-e253-4636-94cf-1511dd1bdbe0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:14.709766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c375f1-7dfc-4931-a873-c497a0333eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:14.710894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c375f1-7dfc-4931-a873-c497a0333eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:14.711189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c375f1-7dfc-4931-a873-c497a0333eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:14.711481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c375f1-7dfc-4931-a873-c497a0333eb5 admin admin] PATH_INFO: `/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:14.713144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c375f1-7dfc-4931-a873-c497a0333eb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=aedab9ecfa9f4a4fb3686cc6fffd6442)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:14.764388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f9c375f1-7dfc-4931-a873-c497a0333eb5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 02 13:31:14.764764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c375f1-7dfc-4931-a873-c497a0333eb5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:14.769892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 2/5] 10.222.0.33 () {56 vars in 1207 bytes} [Thu Jun 2 13:31:14 2022] GET /identity/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:16.979707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded111b-7f23-4741-8230-de8296611339 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:16.980206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded111b-7f23-4741-8230-de8296611339 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:16.980289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded111b-7f23-4741-8230-de8296611339 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:16.984805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 4/6] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:16.991023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564a34b-d7a7-46d9-a584-e1362eb875a0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:16.991398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564a34b-d7a7-46d9-a584-e1362eb875a0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:16.991589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564a34b-d7a7-46d9-a584-e1362eb875a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:17.010666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-1564a34b-d7a7-46d9-a584-e1362eb875a0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:17.012175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1564a34b-d7a7-46d9-a584-e1362eb875a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:17.020132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 3/7] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 02 13:31:17.043978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded111b-7f23-4741-8230-de8296611339 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:17.056917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cded111b-7f23-4741-8230-de8296611339 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:17.061205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca8d33c-aecd-4b1f-96b9-d0dd0479e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:17.061839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8d33c-aecd-4b1f-96b9-d0dd0479e13c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:17.062130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8d33c-aecd-4b1f-96b9-d0dd0479e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:17.062414 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8d33c-aecd-4b1f-96b9-d0dd0479e13c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:17.070926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8d33c-aecd-4b1f-96b9-d0dd0479e13c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:17.072725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca8d33c-aecd-4b1f-96b9-d0dd0479e13c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:17.081845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 5/8] 10.222.0.33 () {58 vars in 1324 bytes} [Thu Jun 2 13:31:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:31:17.087268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564a34b-d7a7-46d9-a584-e1362eb875a0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:17.096210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564a34b-d7a7-46d9-a584-e1362eb875a0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:17.100904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ccfd-0844-4f41-82a4-5d4e63045518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:17.101765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ccfd-0844-4f41-82a4-5d4e63045518 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:17.102052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ccfd-0844-4f41-82a4-5d4e63045518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:17.102332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ccfd-0844-4f41-82a4-5d4e63045518 admin admin] PATH_INFO: `/v3/users/00880a086dd1493eb2030208d4b8d370` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:17.103723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336ccfd-0844-4f41-82a4-5d4e63045518 admin admin] RBAC: Authorizing `identity:get_user(user_id=00880a086dd1493eb2030208d4b8d370)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:17.105629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336ccfd-0844-4f41-82a4-5d4e63045518 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:17.107476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 4/9] 10.222.0.33 () {56 vars in 1198 bytes} [Thu Jun 2 13:31:17 2022] GET /identity/v3/users/00880a086dd1493eb2030208d4b8d370 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:19.429553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990a33-724b-43c0-aafa-72ff061bbf90 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:19.430099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990a33-724b-43c0-aafa-72ff061bbf90 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:19.430099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83990a33-724b-43c0-aafa-72ff061bbf90 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:19.431456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:19.436583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f307a-5ca6-456a-ba12-6cda395acf72 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:19.436995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f307a-5ca6-456a-ba12-6cda395acf72 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:19.437160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f307a-5ca6-456a-ba12-6cda395acf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:19.452358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6ff1b-ef7e-4740-a890-24976ec60607 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:19.452681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6ff1b-ef7e-4740-a890-24976ec60607 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:19.452970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6ff1b-ef7e-4740-a890-24976ec60607 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:19.453959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-af2f307a-5ca6-456a-ba12-6cda395acf72 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:19.454293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 7/11] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:19.455151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-af2f307a-5ca6-456a-ba12-6cda395acf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:19.460281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:19.460603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:19.460892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:19.504796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG passlib.handlers.bcrypt [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80597) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 02 13:31:19.505224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG passlib.handlers.bcrypt [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80597) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 02 13:31:19.538956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 5/12] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:19.552990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:19.554575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:19.561348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f307a-5ca6-456a-ba12-6cda395acf72 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:19.586295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:19.655817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 8/13] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:19.666875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f307a-5ca6-456a-ba12-6cda395acf72 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:19.678584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:19.701307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:19.702114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:19.702402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:19.702688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:19.714945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:19.726134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:19.727162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:19.728034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 6/14] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:19.734454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:19.779892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545623b-fb4e-4429-b491-2f006cfb4098 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:19.782262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:19.820700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:19.822112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:19.825724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:19.826019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:19.826297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:19.840738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d5a8b-0468-4b6b-baf0-8bc6381f905b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:19.875946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:19.876653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:19.876944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:19.877228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:19.878721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:19.879072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:19.880503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:19.893810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 7/15] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:19.899501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:19.907305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:19.908982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:19.999578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0292f2-72e2-4caf-825f-5b1fc5fc57ac None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:20.011473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 9/16] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:20.017223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:20.019932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:20.033634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:20.034514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:20.034796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:20.035064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] PATH_INFO: `/v3/users/00880a086dd1493eb2030208d4b8d370` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:20.036261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] RBAC: Authorizing `identity:get_user(user_id=00880a086dd1493eb2030208d4b8d370)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:20.037758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:20.039634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 8/17] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:19 2022] GET /identity/v3/users/00880a086dd1493eb2030208d4b8d370 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:20.044861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:20.059776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:20.116222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c9b78-ca21-4c53-a227-c071a407252a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:20.151367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:20.151583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858fbff-daa4-489e-91dd-de6dc1879318 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:20.152174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:20.152493 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:20.152779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:20.171338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:20.172864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:20.185973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:20.186762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:20.187051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:20.187330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:20.188538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:20.189991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:20.192371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:31:20.194781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:20.195730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:20.196812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:31:20.196812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:31:20.196812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:31:20.196812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:20.196812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:20.197990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:20.202546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:20.260111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:20.278748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:20.297749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2e3b97-3204-4c52-a32a-dcb6bf78d14d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:20.304973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efdd652-4736-46c0-99bc-50f8e991deae None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:20.332149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac6ea9-56cd-4a41-8c28-888a2b52c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:20.332932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac6ea9-56cd-4a41-8c28-888a2b52c054 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:20.333224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac6ea9-56cd-4a41-8c28-888a2b52c054 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:20.333508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac6ea9-56cd-4a41-8c28-888a2b52c054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:20.334346 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac6ea9-56cd-4a41-8c28-888a2b52c054 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.domain.id=default, user.id=00880a086dd1493eb2030208d4b8d370) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:20.334671 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac6ea9-56cd-4a41-8c28-888a2b52c054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:20.336127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac6ea9-56cd-4a41-8c28-888a2b52c054 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:20.337830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fbf00-6006-4fd1-8f6d-916cb634a225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:20.338482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fbf00-6006-4fd1-8f6d-916cb634a225 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:20.338766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fbf00-6006-4fd1-8f6d-916cb634a225 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:20.339044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fbf00-6006-4fd1-8f6d-916cb634a225 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:20.339773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fbf00-6006-4fd1-8f6d-916cb634a225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:20.340084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fbf00-6006-4fd1-8f6d-916cb634a225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:20.341518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fbf00-6006-4fd1-8f6d-916cb634a225 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:20.343132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 10/20] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Jun 2 13:31:20 2022] GET /identity/v3/role_assignments?user.id=00880a086dd1493eb2030208d4b8d370&scope.domain.id=default&role.id=add60904ef824ad3b92149e0f251f55c => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:20.361193 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 11/21] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:23.050795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad96b-1128-4134-99ad-1020ecf37a23 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.052393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad96b-1128-4134-99ad-1020ecf37a23 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.053307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ad96b-1128-4134-99ad-1020ecf37a23 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.055257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 11/22] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:23.061977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25556e-4c20-4ed6-a117-bfe93bd24af9 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.062435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25556e-4c20-4ed6-a117-bfe93bd24af9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.062623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25556e-4c20-4ed6-a117-bfe93bd24af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.089467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-de25556e-4c20-4ed6-a117-bfe93bd24af9 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:23.090689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-de25556e-4c20-4ed6-a117-bfe93bd24af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:23.126342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead0144-4612-4479-ab1c-ec4a21117dd1 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.127050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead0144-4612-4479-ab1c-ec4a21117dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.127651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead0144-4612-4479-ab1c-ec4a21117dd1 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.129650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 12/23] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:23.134732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834920-0161-40f1-bb57-8224312fced3 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.135279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834920-0161-40f1-bb57-8224312fced3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.135865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834920-0161-40f1-bb57-8224312fced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.163334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0f834920-0161-40f1-bb57-8224312fced3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:23.164980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0f834920-0161-40f1-bb57-8224312fced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:23.207406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 12/24] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:23.256291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25556e-4c20-4ed6-a117-bfe93bd24af9 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:23.282374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 13/25] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:23.313643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834920-0161-40f1-bb57-8224312fced3 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:23.345284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:23.440503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25556e-4c20-4ed6-a117-bfe93bd24af9 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:23.449011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:23.513371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834920-0161-40f1-bb57-8224312fced3 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:23.532723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d43665-d5ca-4cd2-950e-7df6631d734c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:23.533540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43665-d5ca-4cd2-950e-7df6631d734c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.534373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43665-d5ca-4cd2-950e-7df6631d734c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.535262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d43665-d5ca-4cd2-950e-7df6631d734c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.561235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d43665-d5ca-4cd2-950e-7df6631d734c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:23.562725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d43665-d5ca-4cd2-950e-7df6631d734c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-90d43665-d5ca-4cd2-950e-7df6631d734c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:31:23.595455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:23.596511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:23.597403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:31:23.597403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:31:23.597403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:31:23.597403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:23.600612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba1297-adcb-42bd-ab8e-09f8ec184947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:23.600612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba1297-adcb-42bd-ab8e-09f8ec184947 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.600612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba1297-adcb-42bd-ab8e-09f8ec184947 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.600612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba1297-adcb-42bd-ab8e-09f8ec184947 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.600919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 13/26] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:23.608028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea03bd8-920e-46fd-ac69-e493161a9b3c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.608320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea03bd8-920e-46fd-ac69-e493161a9b3c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.608630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea03bd8-920e-46fd-ac69-e493161a9b3c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.610199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:23.610688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea03bd8-920e-46fd-ac69-e493161a9b3c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:23.619626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba1297-adcb-42bd-ab8e-09f8ec184947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-24ba1297-adcb-42bd-ab8e-09f8ec184947 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:23.635871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:23.636808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 14/28] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:23.638996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361157-1b7e-4068-bd46-57d20b6c4eef None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.640706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361157-1b7e-4068-bd46-57d20b6c4eef None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.640706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0361157-1b7e-4068-bd46-57d20b6c4eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.681579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a0361157-1b7e-4068-bd46-57d20b6c4eef None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:23.682801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a0361157-1b7e-4068-bd46-57d20b6c4eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:23.745652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:23.751844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea03bd8-920e-46fd-ac69-e493161a9b3c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:23.798527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:23.801293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:23.803048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:23.803575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:23.804712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:23.806092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:23.808485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:23.837417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 15/29] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:23.839276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:23.855588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 15/30] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:23.856994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361157-1b7e-4068-bd46-57d20b6c4eef None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:23.978629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:23.980983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5907a-4d80-4a2f-93b1-e144cd93c4d5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:24.018797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:24.019821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.020489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.020621 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0361157-1b7e-4068-bd46-57d20b6c4eef None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:24.021128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.022199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:24.022703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:24.024586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:24.038940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 16/31] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:24.044896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:24.059012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53945e9f-465b-4742-aba4-50bb16e16e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:24.059678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945e9f-465b-4742-aba4-50bb16e16e74 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.059972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945e9f-465b-4742-aba4-50bb16e16e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.060258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53945e9f-465b-4742-aba4-50bb16e16e74 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.061175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53945e9f-465b-4742-aba4-50bb16e16e74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:24.062569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53945e9f-465b-4742-aba4-50bb16e16e74 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:24.072520 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:24.161772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63843f-fa3f-4b5e-a5e3-16738d2ddf3f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:24.196961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd54ba-5708-4771-ad9f-31ddc4dcc4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:24.197759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd54ba-5708-4771-ad9f-31ddc4dcc4f8 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.198046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd54ba-5708-4771-ad9f-31ddc4dcc4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.198322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd54ba-5708-4771-ad9f-31ddc4dcc4f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.199076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd54ba-5708-4771-ad9f-31ddc4dcc4f8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:24.200622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd54ba-5708-4771-ad9f-31ddc4dcc4f8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:24.316485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 16/32] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:31:23 2022] POST /identity/v3/projects => generated 301 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:24.318379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274701-ad22-4903-ac07-4efacc1ffe9f None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.318879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274701-ad22-4903-ac07-4efacc1ffe9f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.319364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274701-ad22-4903-ac07-4efacc1ffe9f None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.321505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:24.322562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274701-ad22-4903-ac07-4efacc1ffe9f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:24.441437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274701-ad22-4903-ac07-4efacc1ffe9f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:24.463791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:24.479716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 17/34] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 2 13:31:24 2022] POST /identity/v3/roles => generated 219 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:24.480081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda032-986e-45dd-8d71-10d176e84039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:24.480997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda032-986e-45dd-8d71-10d176e84039 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.481291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda032-986e-45dd-8d71-10d176e84039 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.481578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda032-986e-45dd-8d71-10d176e84039 None admin] PATH_INFO: `/v3/users/00880a086dd1493eb2030208d4b8d370` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.484796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda032-986e-45dd-8d71-10d176e84039 None admin] RBAC: Authorizing `identity:get_user(user_id=00880a086dd1493eb2030208d4b8d370)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:24.484973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda032-986e-45dd-8d71-10d176e84039 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:24.491413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 18/35] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:24 2022] GET /identity/v3/users/00880a086dd1493eb2030208d4b8d370 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:24.491413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bf32-4417-4762-822b-f4d35f384988 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.491413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bf32-4417-4762-822b-f4d35f384988 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.491413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bf32-4417-4762-822b-f4d35f384988 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.491806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6a1d-5bb8-45b1-ad34-287125a10f8d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.491806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6a1d-5bb8-45b1-ad34-287125a10f8d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.491806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb6a1d-5bb8-45b1-ad34-287125a10f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.491977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:24.492928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1bf32-4417-4762-822b-f4d35f384988 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:24.544852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ffeb6a1d-5bb8-45b1-ad34-287125a10f8d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:24.546475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ffeb6a1d-5bb8-45b1-ad34-287125a10f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:24.620429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1bf32-4417-4762-822b-f4d35f384988 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:24.666979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c933cec-4885-4b7f-a474-f4c435ab902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:24.668044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c933cec-4885-4b7f-a474-f4c435ab902d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.668431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c933cec-4885-4b7f-a474-f4c435ab902d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.668789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c933cec-4885-4b7f-a474-f4c435ab902d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.670333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c933cec-4885-4b7f-a474-f4c435ab902d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:24.673762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c933cec-4885-4b7f-a474-f4c435ab902d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:24.676205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 20/37] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:24.677693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acb04-e413-46c5-b18b-5ea27d3c3a5c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.678072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acb04-e413-46c5-b18b-5ea27d3c3a5c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.678425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acb04-e413-46c5-b18b-5ea27d3c3a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.692078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 18/38] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:24.693353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6a1d-5bb8-45b1-ad34-287125a10f8d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:24.699740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8b2acb04-e413-46c5-b18b-5ea27d3c3a5c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:24.701310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8b2acb04-e413-46c5-b18b-5ea27d3c3a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:24.707017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:24.770629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:24.782648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 21/39] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:24.784201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2acb04-e413-46c5-b18b-5ea27d3c3a5c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:24.823122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb6a1d-5bb8-45b1-ad34-287125a10f8d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:24.861136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae5673-4ba4-433b-9c02-26c5c8acf44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:24.862742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5673-4ba4-433b-9c02-26c5c8acf44a None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.863098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5673-4ba4-433b-9c02-26c5c8acf44a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.863443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae5673-4ba4-433b-9c02-26c5c8acf44a None admin] PATH_INFO: `/v3/domains/default/users/00880a086dd1493eb2030208d4b8d370/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.866051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5673-4ba4-433b-9c02-26c5c8acf44a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=00880a086dd1493eb2030208d4b8d370, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:24.867672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae5673-4ba4-433b-9c02-26c5c8acf44a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:24.899746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2acb04-e413-46c5-b18b-5ea27d3c3a5c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:24.933786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7937020-1055-48ad-b255-6ded893c0104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:24.934474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937020-1055-48ad-b255-6ded893c0104 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.934763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937020-1055-48ad-b255-6ded893c0104 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.935040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7937020-1055-48ad-b255-6ded893c0104 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.935780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7937020-1055-48ad-b255-6ded893c0104 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:24.937268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7937020-1055-48ad-b255-6ded893c0104 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:24.989982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 19/40] 10.222.0.33 () {58 vars in 1361 bytes} [Thu Jun 2 13:31:24 2022] PUT /identity/v3/domains/default/users/00880a086dd1493eb2030208d4b8d370/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:24.991340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07230537-4487-4a06-b0ee-53f8810c1960 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:24.991636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07230537-4487-4a06-b0ee-53f8810c1960 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:24.991921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07230537-4487-4a06-b0ee-53f8810c1960 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:24.993232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 20/41] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:24.996900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07230537-4487-4a06-b0ee-53f8810c1960 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:25.072243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:25.088652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 2 13:31:24 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:25.090837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4dcfa-3ecc-485d-a458-dbc6e938d8a1 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.091124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4dcfa-3ecc-485d-a458-dbc6e938d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.091535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4dcfa-3ecc-485d-a458-dbc6e938d8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.120668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-91c4dcfa-3ecc-485d-a458-dbc6e938d8a1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:25.121980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-91c4dcfa-3ecc-485d-a458-dbc6e938d8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:25.124104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07230537-4487-4a06-b0ee-53f8810c1960 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:25.172482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:25.173725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.174298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.174990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.176046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:25.177845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:25.182242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:25.217364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 23/43] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:25.245144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4dcfa-3ecc-485d-a458-dbc6e938d8a1 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:25.254662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 21/44] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 2 13:31:24 2022] POST /identity/v3/roles => generated 223 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:25.374969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4dcfa-3ecc-485d-a458-dbc6e938d8a1 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:25.415716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcd0f3-53e0-4779-a47a-3122d4d8e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:25.416585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd0f3-53e0-4779-a47a-3122d4d8e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.416870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd0f3-53e0-4779-a47a-3122d4d8e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.417199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd0f3-53e0-4779-a47a-3122d4d8e8d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.418474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcd0f3-53e0-4779-a47a-3122d4d8e8d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:25.420085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcd0f3-53e0-4779-a47a-3122d4d8e8d1 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:25.422057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 24/45] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:25.428118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:25.539389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c680d9-26ec-4bc9-ba04-35a4ee124db9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:25.567456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:25.572735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecea11-3c0d-4a40-b1fc-3729c7978b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:25.573399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecea11-3c0d-4a40-b1fc-3729c7978b28 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:25.573688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecea11-3c0d-4a40-b1fc-3729c7978b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:25.573965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecea11-3c0d-4a40-b1fc-3729c7978b28 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:25.574679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecea11-3c0d-4a40-b1fc-3729c7978b28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:25.576126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecea11-3c0d-4a40-b1fc-3729c7978b28 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:25.681094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 22/46] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:31:25 2022] POST /identity/v3/projects => generated 312 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:27.305857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529f0c-fe2b-4385-a26f-15e5fa8a1aba None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.306377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529f0c-fe2b-4385-a26f-15e5fa8a1aba None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.306461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66529f0c-fe2b-4385-a26f-15e5fa8a1aba None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.307788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 25/47] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:27.313198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433cd4-3d2e-4647-85fe-68a4e9369b55 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.313596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433cd4-3d2e-4647-85fe-68a4e9369b55 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.313891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e433cd4-3d2e-4647-85fe-68a4e9369b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.332851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3e433cd4-3d2e-4647-85fe-68a4e9369b55 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:27.334059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3e433cd4-3d2e-4647-85fe-68a4e9369b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:27.400953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 23/48] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:27.424615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529f0c-fe2b-4385-a26f-15e5fa8a1aba None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.467179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:27.526854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66529f0c-fe2b-4385-a26f-15e5fa8a1aba None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.560371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.561124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.561417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.561703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.571832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:27.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:27.580261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:27.581713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 26/49] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:27.587107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e433cd4-3d2e-4647-85fe-68a4e9369b55 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.693264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e433cd4-3d2e-4647-85fe-68a4e9369b55 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.707056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:27.728859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.729571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.729880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.730147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.730899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:27.731213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.732930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.741527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 24/50] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:27.747058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.855678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:27.858814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c1734-1d36-4c9d-8667-aa7bcfb5c1dd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:27.891670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3beef-3b4d-4bb6-855c-894e5b721a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:27.892589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3beef-3b4d-4bb6-855c-894e5b721a7d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.893947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3beef-3b4d-4bb6-855c-894e5b721a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.894253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3beef-3b4d-4bb6-855c-894e5b721a7d None admin] PATH_INFO: `/v3/users/00880a086dd1493eb2030208d4b8d370` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.895464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3beef-3b4d-4bb6-855c-894e5b721a7d None admin] RBAC: Authorizing `identity:get_user(user_id=00880a086dd1493eb2030208d4b8d370)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:27.896977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3beef-3b4d-4bb6-855c-894e5b721a7d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:27.898608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 27/51] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/users/00880a086dd1493eb2030208d4b8d370 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:27.904068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:27.988247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33d86d-bc3d-4c83-b26c-3a6e1c23127e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.988705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33d86d-bc3d-4c83-b26c-3a6e1c23127e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.989061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33d86d-bc3d-4c83-b26c-3a6e1c23127e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:27.990508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 28/52] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:27.995463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acd86e-0f56-45c0-b503-adb67fb163f2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:27.995757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acd86e-0f56-45c0-b503-adb67fb163f2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:27.996039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acd86e-0f56-45c0-b503-adb67fb163f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.002003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672d183-f8a6-49be-a8d3-bd500a001857 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.013504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-70acd86e-0f56-45c0-b503-adb67fb163f2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:28.014702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-70acd86e-0f56-45c0-b503-adb67fb163f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:28.036250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.037072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.037362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.037645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.038822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.040297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.041961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 25/53] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:28.047538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:28.087959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 29/54] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:28.100344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:28.112447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acd86e-0f56-45c0-b503-adb67fb163f2 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:28.156821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19723868-3dde-4ffc-9028-e206f774ed11 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.191258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.191922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.192211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.192525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.193366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.domain.id=default, user.id=00880a086dd1493eb2030208d4b8d370) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:28.193684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.195265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.203380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 26/55] 10.222.0.33 () {56 vars in 1322 bytes} [Thu Jun 2 13:31:28 2022] GET /identity/v3/role_assignments?user.id=00880a086dd1493eb2030208d4b8d370&scope.domain.id=default&role.id=add60904ef824ad3b92149e0f251f55c => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:28.206778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:28.210750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acd86e-0f56-45c0-b503-adb67fb163f2 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.248065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa092021-032c-4517-b981-5d0660b29a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.248918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa092021-032c-4517-b981-5d0660b29a1b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.249205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa092021-032c-4517-b981-5d0660b29a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.249485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa092021-032c-4517-b981-5d0660b29a1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.250761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa092021-032c-4517-b981-5d0660b29a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.252461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa092021-032c-4517-b981-5d0660b29a1b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.254643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 30/56] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:28.260357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:28.370578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c648d31-dcea-49e5-92d4-13fc83a8e050 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:28.378807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:28.405828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c82342-9255-4566-a960-156b8431b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:28.406732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c82342-9255-4566-a960-156b8431b3ff None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:28.407169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c82342-9255-4566-a960-156b8431b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:28.407605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c82342-9255-4566-a960-156b8431b3ff None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:28.408334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c82342-9255-4566-a960-156b8431b3ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:28.410019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c82342-9255-4566-a960-156b8431b3ff None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:28.631173 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 27/57] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Jun 2 13:31:28 2022] POST /identity/v3/projects => generated 298 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:30.862499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1435e-3879-44f6-a8c2-b94d859878bc None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:30.863003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1435e-3879-44f6-a8c2-b94d859878bc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:30.863003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1435e-3879-44f6-a8c2-b94d859878bc None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:30.864363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 31/58] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:30.869540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3d2d6-06e7-41fc-aa04-2ee8c241e36d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:30.869944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3d2d6-06e7-41fc-aa04-2ee8c241e36d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:30.870114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3d2d6-06e7-41fc-aa04-2ee8c241e36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:30.887053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0ef3d2d6-06e7-41fc-aa04-2ee8c241e36d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:30.888250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0ef3d2d6-06e7-41fc-aa04-2ee8c241e36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:30.953705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 28/59] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:30.978101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1435e-3879-44f6-a8c2-b94d859878bc None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:31.091930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1435e-3879-44f6-a8c2-b94d859878bc None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:31.126157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08fec0-eb1c-4241-8831-4f0254e3a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:31.126889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08fec0-eb1c-4241-8831-4f0254e3a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.127198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08fec0-eb1c-4241-8831-4f0254e3a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.128584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08fec0-eb1c-4241-8831-4f0254e3a7b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.129788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08fec0-eb1c-4241-8831-4f0254e3a7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:31.131243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08fec0-eb1c-4241-8831-4f0254e3a7b9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:31.132884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 32/60] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:31.138468 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3d2d6-06e7-41fc-aa04-2ee8c241e36d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:31.233014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:31.245184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3d2d6-06e7-41fc-aa04-2ee8c241e36d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:31.278293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39be920f-9136-4e98-9ed0-34c922d1ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:31.278956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be920f-9136-4e98-9ed0-34c922d1ec0e None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:31.279245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be920f-9136-4e98-9ed0-34c922d1ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:31.279526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39be920f-9136-4e98-9ed0-34c922d1ec0e None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:31.280286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be920f-9136-4e98-9ed0-34c922d1ec0e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:31.282089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39be920f-9136-4e98-9ed0-34c922d1ec0e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:31.366550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 29/61] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:31:31 2022] POST /identity/v3/users => generated 275 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:34.554320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113869d4-011e-4409-970f-3ded77e1d8c8 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:34.555386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113869d4-011e-4409-970f-3ded77e1d8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:34.555926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113869d4-011e-4409-970f-3ded77e1d8c8 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:34.557549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 33/62] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:34.563151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c5ab-a5b0-4384-a139-7d1d14dd750a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:34.564038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c5ab-a5b0-4384-a139-7d1d14dd750a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:34.565257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771c5ab-a5b0-4384-a139-7d1d14dd750a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:34.588211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b771c5ab-a5b0-4384-a139-7d1d14dd750a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:34.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b771c5ab-a5b0-4384-a139-7d1d14dd750a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:34.681117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 30/63] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:34.718106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113869d4-011e-4409-970f-3ded77e1d8c8 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:34.773313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:34.867359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113869d4-011e-4409-970f-3ded77e1d8c8 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:34.919687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:34.920536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:34.920828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:34.921111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:34.939262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:34.947320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:34.948211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:34.949051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 34/64] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:34.956451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771c5ab-a5b0-4384-a139-7d1d14dd750a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.079726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.117521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771c5ab-a5b0-4384-a139-7d1d14dd750a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.170634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f683e2-3cf3-40e3-aaa7-9cba11e7ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.171678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f683e2-3cf3-40e3-aaa7-9cba11e7ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.172192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f683e2-3cf3-40e3-aaa7-9cba11e7ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.172732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f683e2-3cf3-40e3-aaa7-9cba11e7ddc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.173707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f683e2-3cf3-40e3-aaa7-9cba11e7ddc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:35.174801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f683e2-3cf3-40e3-aaa7-9cba11e7ddc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.176475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f683e2-3cf3-40e3-aaa7-9cba11e7ddc4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.185239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 31/65] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:35.191561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.240480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26086fe-4dd1-4678-a470-6344cf669c4a None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.241120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26086fe-4dd1-4678-a470-6344cf669c4a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.241636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26086fe-4dd1-4678-a470-6344cf669c4a None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.243245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 32/66] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:35.245064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955119e0-9875-47cd-871f-d118dbe830e0 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.245574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955119e0-9875-47cd-871f-d118dbe830e0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.246065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955119e0-9875-47cd-871f-d118dbe830e0 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.247504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 33/67] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:35.250147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae683b-823a-4d72-b3c9-632e39343890 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.250685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae683b-823a-4d72-b3c9-632e39343890 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.251184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ae683b-823a-4d72-b3c9-632e39343890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.268799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-49ae683b-823a-4d72-b3c9-632e39343890 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:35.270356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-49ae683b-823a-4d72-b3c9-632e39343890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.330566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.337593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed899ad6-e3e4-4e43-9b90-482352895a54 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.343184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 34/68] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:35.348569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2464-180b-4797-90e1-adbcd9ec542f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.348569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2464-180b-4797-90e1-adbcd9ec542f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.348569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f2464-180b-4797-90e1-adbcd9ec542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.370618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ab8f2464-180b-4797-90e1-adbcd9ec542f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:35.371991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ab8f2464-180b-4797-90e1-adbcd9ec542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.377115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb2bd6-a89f-4641-bbde-4a9bd399f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.377991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2bd6-a89f-4641-bbde-4a9bd399f88e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.378275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2bd6-a89f-4641-bbde-4a9bd399f88e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.378564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb2bd6-a89f-4641-bbde-4a9bd399f88e None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.393185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb2bd6-a89f-4641-bbde-4a9bd399f88e None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.395307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb2bd6-a89f-4641-bbde-4a9bd399f88e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.397057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:35 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:35.398302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420baa8d-db19-4571-97a9-2338fd6c1c5d None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.398599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420baa8d-db19-4571-97a9-2338fd6c1c5d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.398889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420baa8d-db19-4571-97a9-2338fd6c1c5d None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.400339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 36/70] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:35.400866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420baa8d-db19-4571-97a9-2338fd6c1c5d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.453092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.461102 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 35/71] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:35.465494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ceaec-0497-441a-8249-d1f3f97a2727 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.465494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ceaec-0497-441a-8249-d1f3f97a2727 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.465494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ceaec-0497-441a-8249-d1f3f97a2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.484913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-732ceaec-0497-441a-8249-d1f3f97a2727 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:35.488041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-732ceaec-0497-441a-8249-d1f3f97a2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.523529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420baa8d-db19-4571-97a9-2338fd6c1c5d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.555427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 36/72] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:35.556281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ceaec-0497-441a-8249-d1f3f97a2727 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.557645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61817e9d-bd96-4ee2-b64b-de0a56879797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.558428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61817e9d-bd96-4ee2-b64b-de0a56879797 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.558716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61817e9d-bd96-4ee2-b64b-de0a56879797 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.558996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61817e9d-bd96-4ee2-b64b-de0a56879797 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.560176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61817e9d-bd96-4ee2-b64b-de0a56879797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.561663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61817e9d-bd96-4ee2-b64b-de0a56879797 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.564469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:35.565205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37819a7-5a3a-4302-a8f7-c703770709cb None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.565642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37819a7-5a3a-4302-a8f7-c703770709cb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.565819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37819a7-5a3a-4302-a8f7-c703770709cb None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.566949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 38/74] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:35.567661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37819a7-5a3a-4302-a8f7-c703770709cb None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.594595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.665669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ceaec-0497-441a-8249-d1f3f97a2727 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.676062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37819a7-5a3a-4302-a8f7-c703770709cb None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.691291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.699431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e4dda-3b92-4f62-a208-dd1d1d9fd759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.701709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e4dda-3b92-4f62-a208-dd1d1d9fd759 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.701709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e4dda-3b92-4f62-a208-dd1d1d9fd759 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.701709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e4dda-3b92-4f62-a208-dd1d1d9fd759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.710774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.711558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.711845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.712127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.722402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:35.729972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:35.730809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:35.731823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 39/75] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:35.732498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.775350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e4dda-3b92-4f62-a208-dd1d1d9fd759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.776890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e4dda-3b92-4f62-a208-dd1d1d9fd759 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.819216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.837741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b08e0-fea6-416e-abe1-08ea2236bc65 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:35.873505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:35.874113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.874405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.874689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.875397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:35.876893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:35.877106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 37/76] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:35.879071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd38a51-ca68-42bf-ac24-501f1e74595f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:35.879368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd38a51-ca68-42bf-ac24-501f1e74595f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:35.879654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd38a51-ca68-42bf-ac24-501f1e74595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:35.895490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bcd38a51-ca68-42bf-ac24-501f1e74595f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:35.896707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bcd38a51-ca68-42bf-ac24-501f1e74595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:35.916032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:35.960494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 38/77] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:35.961288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd38a51-ca68-42bf-ac24-501f1e74595f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:35.981126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 40/78] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:31:35 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:35.982231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.088910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd38a51-ca68-42bf-ac24-501f1e74595f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.091354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4c424-9697-42cc-920a-95f64ed07aa6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.128206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.128670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.128838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.129118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.129402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.130176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:36.130510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.130738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.131199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.131653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.132023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.134704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.143025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 41/79] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:36.144038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.154542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:36.165199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:36.166124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:36.166876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 39/80] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:31:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:36.167504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.234866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.291147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d9bf7-4b0d-4a9b-9f90-c5fedae70cba None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.329952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.331570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.331867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.332154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.333415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.334901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.336655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 42/81] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:36.338634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.344506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d2f41-9fd6-44ce-9856-e800d83cdb14 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.390120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.391913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.392472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.393100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.408754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:36.413886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:36.420769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:36.421598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:36.422351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:36.425930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 40/82] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:36.426980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.463639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8dcef-25b1-4bba-9014-0c9d3fc29f27 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.514493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.516468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.516928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.517367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] PATH_INFO: `/v3/users/00880a086dd1493eb2030208d4b8d370` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.518888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] RBAC: Authorizing `identity:get_user(user_id=00880a086dd1493eb2030208d4b8d370)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.520731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.523612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.524287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 43/83] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/users/00880a086dd1493eb2030208d4b8d370 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:36.529193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.552939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c661af0-7b04-447f-a1a7-3b8dd1940b21 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.591816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.592527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.592826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.593115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.593882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:36.594450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.595658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.607875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 41/84] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:36.607875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.671097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa318c3-d2de-4f2e-8e9d-7e41df587919 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.709700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.710802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.711326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.711841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.712900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=e8bebc31076d42a2a93c43de34687d79) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:36.713406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.715187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.717295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.720641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67811a67-08ba-4e24-8b6b-7d0ae4281856 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.723919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 44/85] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/role_assignments?user.id=e8bebc31076d42a2a93c43de34687d79&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:36.725183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.793297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.793732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.794005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.794269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.795160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:36.795383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:36.796780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:36.811921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:36.820230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 42/86] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:36.821136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:36.847284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880c4cc3-1f33-41f7-ac95-f82e4f8b6880 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:36.888204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:36.889330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:36.889906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:36.890401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:36.999729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.003797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf49e3e-759f-4be4-8c42-db1cc71afc15 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.012181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.018258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.042263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.043204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.043499 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.043789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.045054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.046782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.048673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 43/87] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:37.049815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.120913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.156661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5044716-15fa-4eae-a6cb-2d7f856e4179 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.196142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.197112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.197462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.197752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.198964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.200528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.203066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 44/88] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:37 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:37.203864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.318185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f43e17-b13b-4e26-b2c5-68f956c6dc9a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.342999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 45/89] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:37.343865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.354977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.355639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.355988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.356282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.376803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.434164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.435692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.563971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 45/90] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:37.565237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.604256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.613629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:37.620891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcb1a12-3ee8-424e-b743-490b7b43100a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.696556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.697199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.697498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.697783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.731867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e32971-33ea-4fb3-a57c-0882c353863e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:37.794968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:37.795839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:37.796129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:37.796434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:37.797706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.799796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:37.801563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 46/91] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:37 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:37.802342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:37.825840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:37.827349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.000763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:38.005188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 46/92] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:38.011619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.011774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450e248-7a6a-4ac5-a86f-a909fb8e2cc1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.012573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:38.089686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.090819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.091299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.091587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.097237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.098759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.106612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 47/93] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:37 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:38.106612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.174327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036a144-a510-41ed-9096-34f2b5cce6b4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.266491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.267086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.267379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.268328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.269373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=00880a086dd1493eb2030208d4b8d370) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:38.269698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.271179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.283574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 47/94] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/role_assignments?user.id=00880a086dd1493eb2030208d4b8d370&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:38.284433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.289122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4574e-afd7-479e-83dd-731b479d79e0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.336181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.337186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.337474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.337755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] PATH_INFO: `/v3/projects/ab0a18ee659041bea5e488c03e7e4056` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.345438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] RBAC: Authorizing `identity:get_project(project_id=ab0a18ee659041bea5e488c03e7e4056)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.347157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.349049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 48/95] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/projects/ab0a18ee659041bea5e488c03e7e4056 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:38.355291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.380791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:38.435637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:38.443412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93b002-90da-4e26-8b3c-230b5e0a2238 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.546361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a26b4-22ed-47c9-9d82-b5c33703102c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.563431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049d162-7901-493a-8c8b-c72100d87e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.565134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049d162-7901-493a-8c8b-c72100d87e67 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.566029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049d162-7901-493a-8c8b-c72100d87e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.566491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049d162-7901-493a-8c8b-c72100d87e67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.569244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049d162-7901-493a-8c8b-c72100d87e67 None admin] RBAC: Adding query filter params (role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=e8bebc31076d42a2a93c43de34687d79) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:38.569865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049d162-7901-493a-8c8b-c72100d87e67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.575225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049d162-7901-493a-8c8b-c72100d87e67 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.587973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 48/96] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/role_assignments?user.id=e8bebc31076d42a2a93c43de34687d79&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:38.591233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cf6f3-fa4e-4131-b419-8e3051388ce7 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.594742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cf6f3-fa4e-4131-b419-8e3051388ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.595250 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cf6f3-fa4e-4131-b419-8e3051388ce7 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.597269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 49/97] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:38.605751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6ba4-872c-4d7f-b363-44f822b44e9d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.606778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6ba4-872c-4d7f-b363-44f822b44e9d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.608827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f6ba4-872c-4d7f-b363-44f822b44e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.629709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.630744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.631237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.631668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.632809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=ab0a18ee659041bea5e488c03e7e4056, user.id=e8bebc31076d42a2a93c43de34687d79) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:38.633287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:38.635023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:38.641639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-630f6ba4-872c-4d7f-b363-44f822b44e9d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:38.642292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 49/98] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/role_assignments?user.id=e8bebc31076d42a2a93c43de34687d79&scope.project.id=ab0a18ee659041bea5e488c03e7e4056&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:38.643165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-630f6ba4-872c-4d7f-b363-44f822b44e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:38.724472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 50/99] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:38.761001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:38.905069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c7665-60f4-4bc9-992b-90458f19dc67 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:38.913654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:38.952528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53442b5-1af9-430b-8850-b7b654c47d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:38.957307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53442b5-1af9-430b-8850-b7b654c47d2f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:38.957607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53442b5-1af9-430b-8850-b7b654c47d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:38.957896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53442b5-1af9-430b-8850-b7b654c47d2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:38.973073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53442b5-1af9-430b-8850-b7b654c47d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-c53442b5-1af9-430b-8850-b7b654c47d2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:38.980831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:38.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:38.982750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:38.983343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 50/100] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:38.989019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f6ba4-872c-4d7f-b363-44f822b44e9d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.075150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.134677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f6ba4-872c-4d7f-b363-44f822b44e9d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.145935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d24d9-6116-4e6c-8730-7cce95f30f58 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.146533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d24d9-6116-4e6c-8730-7cce95f30f58 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.147102 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d24d9-6116-4e6c-8730-7cce95f30f58 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.152527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 51/101] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:39.154153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfc5d-2c65-4bdc-8dee-e190a9d8722d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.154669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfc5d-2c65-4bdc-8dee-e190a9d8722d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.155182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ebfc5d-2c65-4bdc-8dee-e190a9d8722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.184270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.185052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.185348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.185631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.186401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:39.186715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.188127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.190696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-67ebfc5d-2c65-4bdc-8dee-e190a9d8722d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:39.191922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-67ebfc5d-2c65-4bdc-8dee-e190a9d8722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:39.207437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 51/102] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:39.212504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.328127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 52/103] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:39.364521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebfc5d-2c65-4bdc-8dee-e190a9d8722d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.412793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b961faaf-dd82-4175-b087-8b2d46e4b13c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.452779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.476416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.477317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.477610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.477896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] PATH_INFO: `/v3/users/62b2ef19abba409f8f981e2d652cef7b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.507180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] RBAC: Authorizing `identity:get_user(user_id=62b2ef19abba409f8f981e2d652cef7b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.508726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.510721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 52/104] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/users/62b2ef19abba409f8f981e2d652cef7b => generated 289 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:39.515765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.539095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.552036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ebfc5d-2c65-4bdc-8dee-e190a9d8722d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.615040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.616143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.616666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.617260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.620094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.621933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.624944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 53/105] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:39.630679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:39.661252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f8a67-3f2b-4015-bf7f-134df2db372d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.699213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.700587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.700942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.701297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.768589 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726c5ea-cf91-4749-9a96-565497dc97c9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:39.771466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.810449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4554-7f15-456d-a1d0-0b87d610f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:39.813782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4554-7f15-456d-a1d0-0b87d610f432 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.814253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4554-7f15-456d-a1d0-0b87d610f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.815281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4554-7f15-456d-a1d0-0b87d610f432 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.816179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4554-7f15-456d-a1d0-0b87d610f432 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.819497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4554-7f15-456d-a1d0-0b87d610f432 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.824502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:39.824502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:39.911569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 54/106] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:31:39 2022] POST /identity/v3/projects => generated 302 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:39.913335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a641-5cbf-4865-9ceb-c7ace0181339 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.913819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a641-5cbf-4865-9ceb-c7ace0181339 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.915003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a641-5cbf-4865-9ceb-c7ace0181339 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.918194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 55/107] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:39.924482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97132b5-1c55-49ee-a8ca-6b35c3efdd4e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:39.925142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97132b5-1c55-49ee-a8ca-6b35c3efdd4e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:39.925747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97132b5-1c55-49ee-a8ca-6b35c3efdd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:39.960744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d97132b5-1c55-49ee-a8ca-6b35c3efdd4e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:39.962229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d97132b5-1c55-49ee-a8ca-6b35c3efdd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:39.981497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 53/108] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:39.985017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:39.987704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.102610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 56/109] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:40.121102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:40.145397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62aa1f4-88dd-4903-ae44-001e9b360a8b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.160191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97132b5-1c55-49ee-a8ca-6b35c3efdd4e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.229662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.232760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.233281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.233775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.239625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.241595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.246307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 54/110] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:39 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:40.249760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.324249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97132b5-1c55-49ee-a8ca-6b35c3efdd4e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.366779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.368457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.368945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.369471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.381607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:40.390290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:40.391139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:40.391899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:40.394733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 57/111] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:40.401991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.408373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba21067-0dd4-4d91-9bba-bcbbb4344c69 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.420056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:40.472971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.473673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.473938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.474223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.475073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] RBAC: Adding query filter params (role.id=2bf5c7868b6d43a183e4de9ee1aee25c, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=62b2ef19abba409f8f981e2d652cef7b) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:40.475396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.476893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.489896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 55/112] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/role_assignments?user.id=62b2ef19abba409f8f981e2d652cef7b&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=2bf5c7868b6d43a183e4de9ee1aee25c => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:40.604619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd257aa4-48d2-4e23-88c3-628613c7431e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.678866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.679579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.679875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.680163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.680991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:40.681310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.682763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.699943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 58/113] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:40.706384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:40.722629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:40.844546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab105d79-4f05-4d7d-b07c-92baf89c2a17 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:40.893976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:40.895214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:40.895703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:40.896221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:40.897680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:40.899421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:40.901620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 56/114] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:40.910004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:41.021136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:41.072412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1dd3c3-6f5d-49e3-9bdb-70619b38d085 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:41.116001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731468c-fdda-4068-879e-6a6f6c478dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:41.116877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731468c-fdda-4068-879e-6a6f6c478dbc None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.117174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731468c-fdda-4068-879e-6a6f6c478dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.117457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731468c-fdda-4068-879e-6a6f6c478dbc None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.118679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731468c-fdda-4068-879e-6a6f6c478dbc None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:41.120128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3731468c-fdda-4068-879e-6a6f6c478dbc None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:41.122053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 59/115] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:40 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:41.128118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:41.231447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:41.262018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc97231-5016-47b2-bb3e-d8cbf35285bb None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:41.316307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd2544-679d-44fd-ac95-f4ea4494bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:41.317311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2544-679d-44fd-ac95-f4ea4494bb46 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.317784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2544-679d-44fd-ac95-f4ea4494bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.318079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd2544-679d-44fd-ac95-f4ea4494bb46 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/e8bebc31076d42a2a93c43de34687d79/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.320136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd2544-679d-44fd-ac95-f4ea4494bb46 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7344bc63d8b4a1589024f667739a6b5, user_id=e8bebc31076d42a2a93c43de34687d79, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:41.321731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd2544-679d-44fd-ac95-f4ea4494bb46 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:41.419271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 57/116] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:31:41 2022] PUT /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/e8bebc31076d42a2a93c43de34687d79/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:41.450587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6672a-fd03-4a90-bfee-3eb4797fb2e6 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.450587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6672a-fd03-4a90-bfee-3eb4797fb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.450587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6672a-fd03-4a90-bfee-3eb4797fb2e6 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.450587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 60/117] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:41.457689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ea76-8266-405c-8b7a-9b63c185307a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.457999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ea76-8266-405c-8b7a-9b63c185307a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.458272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86ea76-8266-405c-8b7a-9b63c185307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.481800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-dc86ea76-8266-405c-8b7a-9b63c185307a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:41.483130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-dc86ea76-8266-405c-8b7a-9b63c185307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:41.575554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 58/118] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:41.615526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6672a-fd03-4a90-bfee-3eb4797fb2e6 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:41.779955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6672a-fd03-4a90-bfee-3eb4797fb2e6 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:41.829763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:41.831183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:41.831677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:41.832156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:41.834508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:41.849527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:41.858563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:41.859391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:41.860161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 61/119] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:41.870325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ea76-8266-405c-8b7a-9b63c185307a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:41.967593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:42.009496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86ea76-8266-405c-8b7a-9b63c185307a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:42.045179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:42.046165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.046666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.047144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.048135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:42.048718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:42.050316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:42.059251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 59/120] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:42.065581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:42.183466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a699b4-1214-4ff1-90fc-d829827ef7c6 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:42.236351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354edb1d-2d00-4d46-80e5-093914623a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:42.237341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354edb1d-2d00-4d46-80e5-093914623a25 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.237639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354edb1d-2d00-4d46-80e5-093914623a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.237975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354edb1d-2d00-4d46-80e5-093914623a25 None admin] PATH_INFO: `/v3/users/00880a086dd1493eb2030208d4b8d370` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.239281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354edb1d-2d00-4d46-80e5-093914623a25 None admin] RBAC: Authorizing `identity:get_user(user_id=00880a086dd1493eb2030208d4b8d370)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:42.240787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354edb1d-2d00-4d46-80e5-093914623a25 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:42.242504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 62/121] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:42 2022] GET /identity/v3/users/00880a086dd1493eb2030208d4b8d370 => generated 247 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:42.248075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:42.254660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad2e5-5a1e-49a5-91d9-a69c8c1812fc None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.254958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad2e5-5a1e-49a5-91d9-a69c8c1812fc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.255468 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efad2e5-5a1e-49a5-91d9-a69c8c1812fc None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.257822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 63/122] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:42.268424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c679b-37d7-42e5-b341-cddd1a543e93 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.268424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c679b-37d7-42e5-b341-cddd1a543e93 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.268424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c679b-37d7-42e5-b341-cddd1a543e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.301854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c69c679b-37d7-42e5-b341-cddd1a543e93 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:42.303172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c69c679b-37d7-42e5-b341-cddd1a543e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:42.408637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:42.448698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 64/123] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 02 13:31:42.450000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61cc1b-c62e-4006-a2d9-5083b2387df4 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.450302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61cc1b-c62e-4006-a2d9-5083b2387df4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.450592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61cc1b-c62e-4006-a2d9-5083b2387df4 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.451915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 65/124] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:42.457691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843b38-1a89-4a06-a1b1-789405f2a3db None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.457950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843b38-1a89-4a06-a1b1-789405f2a3db None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.458237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1843b38-1a89-4a06-a1b1-789405f2a3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.473295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edd7d1-c3fb-48be-a1e0-aff01402add4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:42.492721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d1843b38-1a89-4a06-a1b1-789405f2a3db None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:42.492721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d1843b38-1a89-4a06-a1b1-789405f2a3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:42.533750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:42.566163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:42.567362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.567849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.568328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.569844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:42.571578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:42.573511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 60/125] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:42 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:42.574746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:42.580605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 66/126] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:42.581519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1843b38-1a89-4a06-a1b1-789405f2a3db None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:42.737804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1843b38-1a89-4a06-a1b1-789405f2a3db None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:42.765850 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:42.778513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:42.779865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.780224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.780737 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/00880a086dd1493eb2030208d4b8d370/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.783004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7344bc63d8b4a1589024f667739a6b5, user_id=00880a086dd1493eb2030208d4b8d370, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:42.785530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:42.798675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891d39-3907-46bd-8672-ef6120c4b71a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:42.836133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:42.837305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:42.837801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:42.838381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:42.849453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:42.858510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:42.859390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:42.860172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:42.862644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 61/127] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:31:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:42.863640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:42.931548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:42.983847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 67/128] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:31:42 2022] PUT /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/00880a086dd1493eb2030208d4b8d370/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:42.985079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:42.988361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bb8c1-8aec-4e3b-801d-4468e133a89c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.029082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.030289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.030792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.031308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.044027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:43.052200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:43.053113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:43.053895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:43.056267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 62/129] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:43.062422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:43.180431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d8cea-4cb0-485b-9e93-c83aea37d8d4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.199252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:43.230694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.232241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.233066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.233681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.235214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:43.235902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:43.241981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:43.242863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb77bd-6a16-4b2b-af7e-a5468ac7c783 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.263732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 63/130] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:43.269894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:43.344500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.345172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.345465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.346309 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.347789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:43.348116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:43.349602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:43.366380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 68/131] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:31:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:43.372258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:43.392214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf4951-9c38-4947-ab25-73b0de548ad9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.429064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.430288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.430853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.431344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.432820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:43.434520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:43.436395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 64/132] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:43 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:43.441936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:43.480568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:43.500354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:43.556029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac07f49-dbb3-494f-9497-1d0439cce544 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.616213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.617438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.617736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.618020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] PATH_INFO: `/v3/projects/ab0a18ee659041bea5e488c03e7e4056` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.623324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] RBAC: Authorizing `identity:get_project(project_id=ab0a18ee659041bea5e488c03e7e4056)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:43.624894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:43.628060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 65/133] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:43 2022] GET /identity/v3/projects/ab0a18ee659041bea5e488c03e7e4056 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:43.634202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:43.638635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb740c4-0307-4c68-8a24-0974796f15ae None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.749170 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.750066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.750379 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.750660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.752004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:43.753550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:43.755484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 69/134] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:43 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:43.760743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:43.861974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f2df3-0d6a-4f0e-8dce-d5655a9b0c0b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.889513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:43.900861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efdb7c-8256-4fd5-85aa-f078e696d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:43.902162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efdb7c-8256-4fd5-85aa-f078e696d967 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.902459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efdb7c-8256-4fd5-85aa-f078e696d967 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.902745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efdb7c-8256-4fd5-85aa-f078e696d967 None admin] PATH_INFO: `/v3/projects/ab0a18ee659041bea5e488c03e7e4056/users/e8bebc31076d42a2a93c43de34687d79/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.904973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efdb7c-8256-4fd5-85aa-f078e696d967 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab0a18ee659041bea5e488c03e7e4056, user_id=e8bebc31076d42a2a93c43de34687d79, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:43.906513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58efdb7c-8256-4fd5-85aa-f078e696d967 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:43.976563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d736b25-5392-4dc3-80c5-df8d36397b5e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:43.979091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 66/135] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:31:43 2022] PUT /identity/v3/projects/ab0a18ee659041bea5e488c03e7e4056/users/e8bebc31076d42a2a93c43de34687d79/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:43.980606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac474e-bb2f-4c41-b996-848c0ddaec7a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.980906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac474e-bb2f-4c41-b996-848c0ddaec7a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.981448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac474e-bb2f-4c41-b996-848c0ddaec7a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:43.982787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 67/136] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:43.996385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2f539-00d0-4e57-8ef3-13620bc5a249 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:43.996823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2f539-00d0-4e57-8ef3-13620bc5a249 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:43.997187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2f539-00d0-4e57-8ef3-13620bc5a249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.035882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:44.039375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6bc2f539-00d0-4e57-8ef3-13620bc5a249 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:44.040668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6bc2f539-00d0-4e57-8ef3-13620bc5a249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:44.089557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a5eb2-9ed2-4030-976f-137b105158fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.090451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5eb2-9ed2-4030-976f-137b105158fd None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.090743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5eb2-9ed2-4030-976f-137b105158fd None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.091027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a5eb2-9ed2-4030-976f-137b105158fd None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.095262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a5eb2-9ed2-4030-976f-137b105158fd None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:44.097385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a5eb2-9ed2-4030-976f-137b105158fd None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:44.099434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 70/137] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:43 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:44.100567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe22479-1021-4afc-8697-42cd5cca1ac6 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.100868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe22479-1021-4afc-8697-42cd5cca1ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.101157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe22479-1021-4afc-8697-42cd5cca1ac6 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.102546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 71/138] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:44.110947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc391-8e42-4a8e-aba2-c316ebd6e853 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.111802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc391-8e42-4a8e-aba2-c316ebd6e853 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.112057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccc391-8e42-4a8e-aba2-c316ebd6e853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.165673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-feccc391-8e42-4a8e-aba2-c316ebd6e853 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:44.166934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-feccc391-8e42-4a8e-aba2-c316ebd6e853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:44.171683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 68/139] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:44.174173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2f539-00d0-4e57-8ef3-13620bc5a249 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:44.275471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 72/140] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:44.281902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc391-8e42-4a8e-aba2-c316ebd6e853 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:44.346147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2f539-00d0-4e57-8ef3-13620bc5a249 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:44.351416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:44.412450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.413362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.413650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.413942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/e8bebc31076d42a2a93c43de34687d79/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.420795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7344bc63d8b4a1589024f667739a6b5, user_id=e8bebc31076d42a2a93c43de34687d79, role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:44.422287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:44.451077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccc391-8e42-4a8e-aba2-c316ebd6e853 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:44.464815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:44.492123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.493357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.493921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.494411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.495879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:44.497650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:44.499785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 73/141] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:44.503055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:44.531263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 69/142] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:31:44 2022] PUT /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/e8bebc31076d42a2a93c43de34687d79/roles/6fcb971d81654e48875c8cd12e298a9e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:44.532352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:44.683924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0c32-5bee-4a8e-a5c8-c5d52f9e8003 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:44.709950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda4892-f9e3-4a91-a846-d64c4ccddc20 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:44.734579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc8f924-0d5e-478a-973e-e7405f3d9dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.735396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8f924-0d5e-478a-973e-e7405f3d9dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.735688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8f924-0d5e-478a-973e-e7405f3d9dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.736612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc8f924-0d5e-478a-973e-e7405f3d9dc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.754395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a4e6cf-22c5-42e2-9037-1dc8fc5d6127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.755104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4e6cf-22c5-42e2-9037-1dc8fc5d6127 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.755398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4e6cf-22c5-42e2-9037-1dc8fc5d6127 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.755686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a4e6cf-22c5-42e2-9037-1dc8fc5d6127 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.757942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4e6cf-22c5-42e2-9037-1dc8fc5d6127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:44.760423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a4e6cf-22c5-42e2-9037-1dc8fc5d6127 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:44.767964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc8f924-0d5e-478a-973e-e7405f3d9dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-6fc8f924-0d5e-478a-973e-e7405f3d9dc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:44.779511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:44.780462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 74/143] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:44.782109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ccb0a-6d7e-4f91-8cf6-8a46669ed046 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.782794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ccb0a-6d7e-4f91-8cf6-8a46669ed046 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.782794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56ccb0a-6d7e-4f91-8cf6-8a46669ed046 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.788707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 75/144] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:44.789573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ccb0a-6d7e-4f91-8cf6-8a46669ed046 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:44.836709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:44.910633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 70/145] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:31:44 2022] POST /identity/v3/users => generated 283 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:44.911948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2c908-d22b-473c-a985-abf81e684e48 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.912244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2c908-d22b-473c-a985-abf81e684e48 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.916599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56ccb0a-6d7e-4f91-8cf6-8a46669ed046 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:44.916757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2c908-d22b-473c-a985-abf81e684e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.956699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-50b2c908-d22b-473c-a985-abf81e684e48 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:44.957924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-50b2c908-d22b-473c-a985-abf81e684e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:44.965202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:44.967312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:44.967767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:44.968258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:44.969364 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:44.969865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:44.972179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:44.988798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 76/146] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:44.994805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:44.998416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:45.123663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:45.128888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ed648-3028-4674-ab41-7c50f98b2105 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:45.150863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 71/147] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:45.183314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2c908-d22b-473c-a985-abf81e684e48 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:45.202722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:45.206632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:45.206632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:45.206632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] PATH_INFO: `/v3/users/62b2ef19abba409f8f981e2d652cef7b` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:45.209366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] RBAC: Authorizing `identity:get_user(user_id=62b2ef19abba409f8f981e2d652cef7b)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:45.210839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:45.212622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 77/148] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:44 2022] GET /identity/v3/users/62b2ef19abba409f8f981e2d652cef7b => generated 289 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:45.219584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:45.359107 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2c908-d22b-473c-a985-abf81e684e48 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:45.398320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4826d0-0957-468c-bef8-f81339d899a8 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:45.436103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:45.437439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:45.438388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:45.439949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:45.448430 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:45.449619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:45.450102 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:45.450618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:45.452429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:45.454118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:45.458711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 78/149] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:45 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:45.464910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:45.470055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:45.486501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:45.487445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:45.488204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:45.492335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 72/150] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:45.504470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:45.528825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:45.552178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:45.692828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f34ff-d470-4d6c-b656-9ad365f961d2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:45.707145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6fb93-f0ff-4af8-8fa7-ce1b8273d983 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:45.756693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:45.756879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:45.757519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:45.757771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:45.757892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:45.758082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/62b2ef19abba409f8f981e2d652cef7b/roles/2bf5c7868b6d43a183e4de9ee1aee25c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:45.758342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:45.758721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:45.759577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] RBAC: Adding query filter params (name=member) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:45.759997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:45.761523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:45.765318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] RBAC: Authorizing `identity:create_grant(project_id=a7344bc63d8b4a1589024f667739a6b5, user_id=62b2ef19abba409f8f981e2d652cef7b, role_id=2bf5c7868b6d43a183e4de9ee1aee25c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:45.766813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:45.773564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 73/151] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:45.782085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:45.861856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:45.890648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 79/152] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:31:45 2022] PUT /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5/users/62b2ef19abba409f8f981e2d652cef7b/roles/2bf5c7868b6d43a183e4de9ee1aee25c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:45.894574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2584c70-6e31-4c98-b6bf-e82a2c76651c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:45.934736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf496d63-5160-478c-ab54-a45f2c5a483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:45.935628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496d63-5160-478c-ab54-a45f2c5a483a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:45.935912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496d63-5160-478c-ab54-a45f2c5a483a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:45.936194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf496d63-5160-478c-ab54-a45f2c5a483a None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:45.937458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf496d63-5160-478c-ab54-a45f2c5a483a None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:45.938996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf496d63-5160-478c-ab54-a45f2c5a483a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:45.941584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 74/153] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:45 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:45.947331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:46.066750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5325c-67cb-421a-a08f-f99011dade7c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:46.067246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5325c-67cb-421a-a08f-f99011dade7c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:46.067246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5325c-67cb-421a-a08f-f99011dade7c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:46.074532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 75/154] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:46.082083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe460b-3a43-48fe-92ea-7e0bda6a93a4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:46.088304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe460b-3a43-48fe-92ea-7e0bda6a93a4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:46.088842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe460b-3a43-48fe-92ea-7e0bda6a93a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:46.132278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6cfe460b-3a43-48fe-92ea-7e0bda6a93a4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:46.134293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6cfe460b-3a43-48fe-92ea-7e0bda6a93a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:46.144810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:46.150147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b8d8-176b-4061-90ae-e78aeef7b6ed None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:46.206999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:46.207705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:46.209494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:46.209494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:46.307159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 76/155] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:46.319721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:46.321176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:46.354412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe460b-3a43-48fe-92ea-7e0bda6a93a4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:46.435645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:46.443667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 80/156] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:46.452350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:46.528816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:46.579487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68fb4d-5c8a-4d91-b7ba-23e58db8395d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:46.585904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe460b-3a43-48fe-92ea-7e0bda6a93a4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:46.627808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:46.629290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:46.629780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:46.630260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:46.632302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:46.634891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:46.637279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 81/157] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:46 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:46.645227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:46.660735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:46.661550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:46.661889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:46.662121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:46.681432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:46.695359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:46.696331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:46.698241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:46.699325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 77/158] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:46.707460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:46.772777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:46.845996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd61d61-b7d6-4afc-a4c7-2ade70e4fcfa None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:46.904184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1b213-89de-4bf1-b631-17110f1e89a0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:46.914371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:46.915053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:46.915342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:46.915624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:46.916499 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=e8bebc31076d42a2a93c43de34687d79) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:46.916819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:46.918290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:46.933217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 82/159] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:46 2022] GET /identity/v3/role_assignments?user.id=e8bebc31076d42a2a93c43de34687d79&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:46.964796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:46.969902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:46.970655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:46.970940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:46.971199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:46.972079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:46.972419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:46.977992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:46.989736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 78/160] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:46.999126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:47.134272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664e10-6ab8-4009-b203-11940ea362b6 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:47.173838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:47.181972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:47.182870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:47.183160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:47.183443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] PATH_INFO: `/v3/users/00880a086dd1493eb2030208d4b8d370` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:47.185116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] RBAC: Authorizing `identity:get_user(user_id=00880a086dd1493eb2030208d4b8d370)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:47.186584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:47.188663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 83/161] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:46 2022] GET /identity/v3/users/00880a086dd1493eb2030208d4b8d370 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:47.194585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:47.316515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6a717-d5c4-484d-8d6e-05c9bf30b0ca None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:47.362989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:47.363668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:47.364012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:47.364536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:47.448587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:47.459720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:47.461244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:47.593715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 79/162] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:47.599561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:47.712297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3cec80-c0fd-4341-834f-47da6fbf1e81 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:47.751113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb083d5-9d7f-415c-baf7-d72522d4cba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:47.752818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb083d5-9d7f-415c-baf7-d72522d4cba2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:47.753064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb083d5-9d7f-415c-baf7-d72522d4cba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:47.753378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb083d5-9d7f-415c-baf7-d72522d4cba2 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:47.754723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb083d5-9d7f-415c-baf7-d72522d4cba2 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:47.756274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb083d5-9d7f-415c-baf7-d72522d4cba2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:47.758085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 84/163] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:47 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:47.764239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:47.781508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d568f9-876e-4664-954a-4f88b7608b10 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:47.781809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d568f9-876e-4664-954a-4f88b7608b10 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:47.782076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d568f9-876e-4664-954a-4f88b7608b10 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:47.784040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 85/164] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:47.790338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f4525-728b-47b5-9aea-c97794172659 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:47.790629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f4525-728b-47b5-9aea-c97794172659 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:47.790914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f4525-728b-47b5-9aea-c97794172659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:47.813153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-cb0f4525-728b-47b5-9aea-c97794172659 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:47.814995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-cb0f4525-728b-47b5-9aea-c97794172659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:47.893763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:47.900788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:47.907815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 86/165] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:47.914335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb0ca36-3931-49e4-a982-9d1f81110f5b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:47.965594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:47.966180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:47.966465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:47.966743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:47.967579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=00880a086dd1493eb2030208d4b8d370) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:47.967889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:47.969373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:47.979210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f4525-728b-47b5-9aea-c97794172659 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:47.994762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 80/166] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:47 2022] GET /identity/v3/role_assignments?user.id=00880a086dd1493eb2030208d4b8d370&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:48.098438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f4525-728b-47b5-9aea-c97794172659 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:48.136082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:48.136930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:48.137221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:48.137503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:48.153518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:48.162238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:48.163076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:48.164792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 87/167] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:48.169235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:48.304441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc80e70-b8d7-4ec3-a86e-e008b04bbbdf None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:48.355669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:48.356628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:48.356916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:48.357195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:48.357963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:48.358272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:48.359690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:48.372625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 81/168] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:48.379113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:48.451746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:48.512748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75b667-e0ab-44a0-841d-e2b271ddf057 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:48.562422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568447e2-a85d-408b-9a58-7a2c36ef5eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:48.563228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568447e2-a85d-408b-9a58-7a2c36ef5eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:48.563525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568447e2-a85d-408b-9a58-7a2c36ef5eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:48.563811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568447e2-a85d-408b-9a58-7a2c36ef5eb2 None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:48.569147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568447e2-a85d-408b-9a58-7a2c36ef5eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:48.570622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568447e2-a85d-408b-9a58-7a2c36ef5eb2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:48.572477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 88/169] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:48 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:48.577756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:48.605055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:48.707710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30921946-ad87-4172-8dbc-1f6a6f878bdd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:48.751088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:48.752753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:48.753248 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:48.753760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:48.840101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:48.841943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:48.869273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:49.002871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 82/170] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:49.004581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9293-a337-428d-b3c1-c2d5fbaff77f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.005022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9293-a337-428d-b3c1-c2d5fbaff77f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.005209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae9293-a337-428d-b3c1-c2d5fbaff77f None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.006536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 89/171] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:49.012066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:49.016212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145a4c-83ef-421b-8121-46ede1f15f76 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.016535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145a4c-83ef-421b-8121-46ede1f15f76 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.016822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2145a4c-83ef-421b-8121-46ede1f15f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.050264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c2145a4c-83ef-421b-8121-46ede1f15f76 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:49.051470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c2145a4c-83ef-421b-8121-46ede1f15f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:49.137581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47516aba-4e22-4f14-9e3c-0df8f7475c3c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:49.159606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:49.184345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:49.186141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.186716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.187199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] PATH_INFO: `/v3/projects/ab0a18ee659041bea5e488c03e7e4056` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.188686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] RBAC: Authorizing `identity:get_project(project_id=ab0a18ee659041bea5e488c03e7e4056)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:49.191270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:49.194642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 83/172] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:49 2022] GET /identity/v3/projects/ab0a18ee659041bea5e488c03e7e4056 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:49.202341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:49.219730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 90/173] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:49.295973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2145a4c-83ef-421b-8121-46ede1f15f76 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:49.368451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cd953-e40a-4484-b2d4-f7ebf967416d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:49.383693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:49.433569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:49.434147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.434436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.434715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.435563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=ab0a18ee659041bea5e488c03e7e4056, user.id=e8bebc31076d42a2a93c43de34687d79) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:49.435879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:49.437376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:49.448111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 84/174] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:49 2022] GET /identity/v3/role_assignments?user.id=e8bebc31076d42a2a93c43de34687d79&scope.project.id=ab0a18ee659041bea5e488c03e7e4056&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:49.464589 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2145a4c-83ef-421b-8121-46ede1f15f76 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:49.525884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169eb3a2-280c-43d3-9c46-01804f06c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:49.526732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb3a2-280c-43d3-9c46-01804f06c3eb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.527020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb3a2-280c-43d3-9c46-01804f06c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.527299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169eb3a2-280c-43d3-9c46-01804f06c3eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.553644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169eb3a2-280c-43d3-9c46-01804f06c3eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-169eb3a2-280c-43d3-9c46-01804f06c3eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:49.561876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:49.562734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:49.563555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 91/175] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:31:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:49.570485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:49.654465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:49.716587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56392e-dfa2-4cc1-95cb-6a5bfd0e9e5f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:49.723143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca7ff-0913-49f8-a4f7-cafe541b2d4f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.723450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca7ff-0913-49f8-a4f7-cafe541b2d4f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.723702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca7ff-0913-49f8-a4f7-cafe541b2d4f None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.725171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 92/176] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:49.733985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897081e-a8d4-4881-82ec-e778fb76918b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.734314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897081e-a8d4-4881-82ec-e778fb76918b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.734550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897081e-a8d4-4881-82ec-e778fb76918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.777477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b897081e-a8d4-4881-82ec-e778fb76918b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:49.778689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b897081e-a8d4-4881-82ec-e778fb76918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:49.781404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:49.782405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:49.782940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:49.783452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:49.784447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:49.784966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:49.787754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:49.804920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 85/177] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:31:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:49.812485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:49.894250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 93/178] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:49.921318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897081e-a8d4-4881-82ec-e778fb76918b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:49.972864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.043955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897081e-a8d4-4881-82ec-e778fb76918b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.082988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.083791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.084081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.084359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.094565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b84747-7100-4274-8942-bb771be3a24e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.096261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:50.110477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:50.111944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:50.112780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 94/179] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:50.120140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.126141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.167943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.168667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.169018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.169300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] PATH_INFO: `/v3/users/e8bebc31076d42a2a93c43de34687d79` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.170735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] RBAC: Authorizing `identity:get_user(user_id=e8bebc31076d42a2a93c43de34687d79)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.173923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.175909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 86/180] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:49 2022] GET /identity/v3/users/e8bebc31076d42a2a93c43de34687d79 => generated 275 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:50.181864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.329754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858d33d-6ac8-4c70-8701-34d3d3f77d6d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.331425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.390852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fc9e-4423-41f3-8370-4b6b1e65d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.392185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fc9e-4423-41f3-8370-4b6b1e65d53d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.392672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fc9e-4423-41f3-8370-4b6b1e65d53d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.393058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fc9e-4423-41f3-8370-4b6b1e65d53d None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.394306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fc9e-4423-41f3-8370-4b6b1e65d53d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:50.394728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fc9e-4423-41f3-8370-4b6b1e65d53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.396597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fc9e-4423-41f3-8370-4b6b1e65d53d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.408755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 95/181] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:50.412918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f61d-693f-49d9-8c52-2a38f921f766 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.413349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f61d-693f-49d9-8c52-2a38f921f766 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.413758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f61d-693f-49d9-8c52-2a38f921f766 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.415495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 96/182] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:50.420245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f61d-693f-49d9-8c52-2a38f921f766 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.434627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2822de-5ac1-4c7b-b858-45e4c377f783 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.489601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75d6b4b-8d0c-44b9-aac7-4422ad670c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.491191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d6b4b-8d0c-44b9-aac7-4422ad670c63 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.491630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d6b4b-8d0c-44b9-aac7-4422ad670c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.492368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d6b4b-8d0c-44b9-aac7-4422ad670c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.544569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f61d-693f-49d9-8c52-2a38f921f766 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.560546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.582419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955f66e-6b93-481a-bfb7-065b7cb5fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.583222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955f66e-6b93-481a-bfb7-065b7cb5fc2b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.583508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955f66e-6b93-481a-bfb7-065b7cb5fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.583877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955f66e-6b93-481a-bfb7-065b7cb5fc2b None admin] PATH_INFO: `/v3/users/6084f23e03f9492394bd2cad3f460dbc` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.585518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d6b4b-8d0c-44b9-aac7-4422ad670c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.587021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75d6b4b-8d0c-44b9-aac7-4422ad670c63 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.599731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955f66e-6b93-481a-bfb7-065b7cb5fc2b None admin] RBAC: Authorizing `identity:get_user(user_id=6084f23e03f9492394bd2cad3f460dbc)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.601242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955f66e-6b93-481a-bfb7-065b7cb5fc2b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.602947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 97/183] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:50 2022] GET /identity/v3/users/6084f23e03f9492394bd2cad3f460dbc => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:50.604916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2822d0-e583-48ed-abcf-a2a8b109467d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.605218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2822d0-e583-48ed-abcf-a2a8b109467d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.605504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2822d0-e583-48ed-abcf-a2a8b109467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.622691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6f2822d0-e583-48ed-abcf-a2a8b109467d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:50.623884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6f2822d0-e583-48ed-abcf-a2a8b109467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:50.640763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.692249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 87/184] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:50.692806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 98/185] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:50.694027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e64c-74e0-4f4d-9072-a45c0aabf84c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.694319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e64c-74e0-4f4d-9072-a45c0aabf84c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.694486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4273ac-d5c7-4137-9fb0-c9b9cf46b523 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.694574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95e64c-74e0-4f4d-9072-a45c0aabf84c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.694982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4273ac-d5c7-4137-9fb0-c9b9cf46b523 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.695383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4273ac-d5c7-4137-9fb0-c9b9cf46b523 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.695843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 99/186] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:50.696566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e64c-74e0-4f4d-9072-a45c0aabf84c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.697108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 88/187] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:50.700054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4273ac-d5c7-4137-9fb0-c9b9cf46b523 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:50.792454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.807005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95e64c-74e0-4f4d-9072-a45c0aabf84c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.811969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4273ac-d5c7-4137-9fb0-c9b9cf46b523 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:50.841497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.842069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.842359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.842643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.846426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224d703-fbab-4791-9288-6802c14a46f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:50.847294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224d703-fbab-4791-9288-6802c14a46f7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.847575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224d703-fbab-4791-9288-6802c14a46f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.847849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224d703-fbab-4791-9288-6802c14a46f7 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.849034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224d703-fbab-4791-9288-6802c14a46f7 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.850503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224d703-fbab-4791-9288-6802c14a46f7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.852183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 89/188] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:50 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:50.853439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06204-4cf2-4540-a598-fc319b00dc87 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.853726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06204-4cf2-4540-a598-fc319b00dc87 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.853998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06204-4cf2-4540-a598-fc319b00dc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.864863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:50.871040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-aaa06204-4cf2-4540-a598-fc319b00dc87 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:50.872220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-aaa06204-4cf2-4540-a598-fc319b00dc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:50.911933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:50.913440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:50.938806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 90/189] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:50.940791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c512f0-aa93-4857-8ee1-fcf4d0e726bb None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:50.941102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c512f0-aa93-4857-8ee1-fcf4d0e726bb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:50.941381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c512f0-aa93-4857-8ee1-fcf4d0e726bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:50.957609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a5c512f0-aa93-4857-8ee1-fcf4d0e726bb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:50.958807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a5c512f0-aa93-4857-8ee1-fcf4d0e726bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:51.022394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 100/190] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:51.022394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.031178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 91/191] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:51.032136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c512f0-aa93-4857-8ee1-fcf4d0e726bb None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.042496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.086248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.132608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2b008-ebee-4244-8a36-7fef5720f1bf None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.134180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c512f0-aa93-4857-8ee1-fcf4d0e726bb None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.171477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.172261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.172574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.172851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.173740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.174006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.174353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.174643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.174923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.175470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.175750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] RBAC: Adding query filter params (role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=e8bebc31076d42a2a93c43de34687d79) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:51.176059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.177130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 101/192] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:51.177608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.177883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.189772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 92/193] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/role_assignments?user.id=e8bebc31076d42a2a93c43de34687d79&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:51.189772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.269611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.299617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b77dd-8f43-4f56-9ec2-ff94e4e6847e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.302603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d0619-42be-47ff-8b35-41748c86a70d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.322045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.338087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.338908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.339198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.339476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.342894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.343982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.344464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.344882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.346648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.348371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.350549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 93/194] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:51.351520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.356537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:51.365689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:51.366667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 102/195] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:51.367902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.480905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a2497-7a64-4f13-a752-cf1b9f53e2e6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.489435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bbbd4d-bf42-4a89-a5c3-03515ae4057c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.518747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.519553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.519833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.520108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.523728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.524393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.524714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.524994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.525704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.527147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.527825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.530746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:51.539591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:51.549277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 94/196] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:51.550457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.639094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 103/197] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:31:51 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:51.639953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.640204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bae1f-df71-4e73-829a-0d91da4f8578 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.678119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.678793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.679081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.679363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.680212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=6084f23e03f9492394bd2cad3f460dbc) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:51.680579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.682075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.688227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 95/198] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/role_assignments?user.id=6084f23e03f9492394bd2cad3f460dbc&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:51.689775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.713241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.780765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.804763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf23a4-c3fe-455d-98ec-5888a2e4082b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.835354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa876e-5b17-403f-b715-4dd63e901ec2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:51.846887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.847585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.847875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.848158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.849026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:51.849338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.850965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.861709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 104/199] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:51.867510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.891031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:51.892010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:51.892607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:51.893058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:51.893860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:51.894163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:51.895641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:51.905107 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 96/200] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:51.911742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:51.991757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:51.996766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b3fd3-8742-4beb-909e-00ab533f53b3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.054691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.055507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.055798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.056074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] PATH_INFO: `/v3/users/62b2ef19abba409f8f981e2d652cef7b` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.057411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] RBAC: Authorizing `identity:get_user(user_id=62b2ef19abba409f8f981e2d652cef7b)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.058874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.060579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 105/201] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/users/62b2ef19abba409f8f981e2d652cef7b => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:52.065981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65bce35-4484-4d25-9d11-278cbe15f988 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.070130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:52.099078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.107957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.108872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.109152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.109422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] PATH_INFO: `/v3/users/6084f23e03f9492394bd2cad3f460dbc` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.110645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] RBAC: Authorizing `identity:get_user(user_id=6084f23e03f9492394bd2cad3f460dbc)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.114419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.118906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 97/202] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:51 2022] GET /identity/v3/users/6084f23e03f9492394bd2cad3f460dbc => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:52.120115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:52.188932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a56f2-707b-4be4-ad92-49c759905a33 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.227015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.227670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.227958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.228233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.233055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ec200-848f-49bf-baad-09174eebd88e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.269547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.269865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.270430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.270716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.270993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.305136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.306614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.337649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.345574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.347448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.413146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 106/203] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:52.424116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:52.515883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 98/204] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:52.521822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:52.536762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.596057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7ce90-9e13-4308-b7de-e418231d5703 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.658982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.659948 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.660241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.660552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.661758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.663207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.664999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 107/205] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:52 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:52.670706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:52.711826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.732465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c5f9-14d2-4c74-8aee-457a20f1ea79 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.806048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.806917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.807196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.807468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.809158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.810608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.815274 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 99/206] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:52 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:52.821049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:52.843979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4961b-e620-48f2-b3ab-0729bd72a866 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:52.914569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acb13d-0fdb-4afd-8488-32425ae2e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:52.915200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb13d-0fdb-4afd-8488-32425ae2e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:52.915484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb13d-0fdb-4afd-8488-32425ae2e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:52.915762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acb13d-0fdb-4afd-8488-32425ae2e8b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:52.916659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acb13d-0fdb-4afd-8488-32425ae2e8b3 None admin] RBAC: Adding query filter params (role.id=2bf5c7868b6d43a183e4de9ee1aee25c, scope.project.id=a7344bc63d8b4a1589024f667739a6b5, user.id=62b2ef19abba409f8f981e2d652cef7b) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:52.916972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acb13d-0fdb-4afd-8488-32425ae2e8b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:52.919846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acb13d-0fdb-4afd-8488-32425ae2e8b3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:52.924701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:52.930796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 108/207] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:52 2022] GET /identity/v3/role_assignments?user.id=62b2ef19abba409f8f981e2d652cef7b&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=2bf5c7868b6d43a183e4de9ee1aee25c => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:52.992356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33aa2b-f20e-497d-8103-858ab1ed95a1 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:53.046034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3911b78-8dca-4494-bfe8-2014f75a12ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:53.046686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911b78-8dca-4494-bfe8-2014f75a12ef None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:53.046966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911b78-8dca-4494-bfe8-2014f75a12ef None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:53.047242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3911b78-8dca-4494-bfe8-2014f75a12ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:53.048070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911b78-8dca-4494-bfe8-2014f75a12ef None admin] RBAC: Adding query filter params (role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=6084f23e03f9492394bd2cad3f460dbc) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:53.048923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911b78-8dca-4494-bfe8-2014f75a12ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:53.050371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3911b78-8dca-4494-bfe8-2014f75a12ef None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:53.061013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 100/208] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:52 2022] GET /identity/v3/role_assignments?user.id=6084f23e03f9492394bd2cad3f460dbc&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:54.252829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aadeb-9c67-440e-b307-ca2a7f930c8f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.253855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aadeb-9c67-440e-b307-ca2a7f930c8f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.254350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aadeb-9c67-440e-b307-ca2a7f930c8f None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.255984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 109/209] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:54.261595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b36b1e-e082-4d06-b020-e16661cbc58c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.262422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b36b1e-e082-4d06-b020-e16661cbc58c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.262907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b36b1e-e082-4d06-b020-e16661cbc58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.280812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-26b36b1e-e082-4d06-b020-e16661cbc58c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:54.282326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-26b36b1e-e082-4d06-b020-e16661cbc58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:54.305208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:54.357429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 101/210] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:54.380586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aadeb-9c67-440e-b307-ca2a7f930c8f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:54.504446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aadeb-9c67-440e-b307-ca2a7f930c8f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:54.538833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6672a-6779-4b03-bff5-9ea251cf4de0 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.539133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6672a-6779-4b03-bff5-9ea251cf4de0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.539396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6672a-6779-4b03-bff5-9ea251cf4de0 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.540974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 102/211] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:31:54.543713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:54.544543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.544832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.545115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.548102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ee63-7b8a-4552-a4b4-4b5c4fddff8d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.548102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ee63-7b8a-4552-a4b4-4b5c4fddff8d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.548102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3ee63-7b8a-4552-a4b4-4b5c4fddff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.562637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:54.568931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a0e3ee63-7b8a-4552-a4b4-4b5c4fddff8d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:54.570367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a0e3ee63-7b8a-4552-a4b4-4b5c4fddff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:54.572700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:54.573600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:54.574630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:54.578898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 110/212] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:54.580683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:54.650302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 103/213] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:54.651705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae3a07-11ab-426e-ad24-68c1f2b91f34 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.652000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae3a07-11ab-426e-ad24-68c1f2b91f34 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.652280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae3a07-11ab-426e-ad24-68c1f2b91f34 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.658362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 104/214] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:54.660263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d331c5-dda3-4830-addb-df1d62ca9e84 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.660720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d331c5-dda3-4830-addb-df1d62ca9e84 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.661170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d331c5-dda3-4830-addb-df1d62ca9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.663286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:54.679979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-00d331c5-dda3-4830-addb-df1d62ca9e84 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:54.681190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-00d331c5-dda3-4830-addb-df1d62ca9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:54.706665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa32a2-2a13-49dc-9ae0-9f7470ea58f9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:54.744782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:54.745453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.745747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.746028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.746793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:54.747096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:54.748528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:54.752115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 105/215] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:54.753251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d331c5-dda3-4830-addb-df1d62ca9e84 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:54.770335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 111/216] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:54.775221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:54.776644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:54.863001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d331c5-dda3-4830-addb-df1d62ca9e84 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:54.890043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99bfd5-376d-41e8-9041-3f1727afed71 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:54.900558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:54.901361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.901832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.901940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.911916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:54.912846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:54.920973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:54.927865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 106/217] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:54.928727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:54.932650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:54.933587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:54.933926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:54.934209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] PATH_INFO: `/v3/users/6084f23e03f9492394bd2cad3f460dbc` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:54.935427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] RBAC: Authorizing `identity:get_user(user_id=6084f23e03f9492394bd2cad3f460dbc)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:54.936991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:54.938667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 112/218] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:54 2022] GET /identity/v3/users/6084f23e03f9492394bd2cad3f460dbc => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:54.940072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.015117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:55.039921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42041099-9eea-4311-93cc-ec2cda75bb72 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.049202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e64e0-646d-4d18-b131-4bf6ac72a3c1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.074059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.074848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.075131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.075407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.076659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.078046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.084528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 107/219] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:55.084528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.091202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.091868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.092153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.092454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.093216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:55.093518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.094890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.103456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 113/220] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:55.104244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.159542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:55.200902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9ec9-d109-4850-9c2b-4265ae5bf6fb None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.221538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc50eb1-daa0-4245-a012-b88862855174 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.240650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.241519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.241804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.242080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.243525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.245152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.251871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 108/221] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:55 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:55.251871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.263441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.264108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.264394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.264704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.265357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:55.265729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.267627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.350169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258cfcc-24fb-449b-8d5b-16670f7a6d05 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.362084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 114/222] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:31:55 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:55.362084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.388781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.389835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.390120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.390396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] PATH_INFO: `/v3/users/5845871f828442f282adb4a14f6cc474` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.408839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] RBAC: Authorizing `identity:get_user(user_id=5845871f828442f282adb4a14f6cc474)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.410395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.412331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 109/223] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:55 2022] GET /identity/v3/users/5845871f828442f282adb4a14f6cc474 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:55.417894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.504005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:55.525563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cafb9-25f5-4593-82f3-50da7dd3aeac None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.534329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:55.537851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec541be5-1c9e-494b-bdd4-3e3a3efbff92 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.563111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909749f-2105-418d-920b-9e70879f826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.564753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909749f-2105-418d-920b-9e70879f826f None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.565063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909749f-2105-418d-920b-9e70879f826f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.565346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909749f-2105-418d-920b-9e70879f826f None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/6084f23e03f9492394bd2cad3f460dbc/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.567478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909749f-2105-418d-920b-9e70879f826f None admin] RBAC: Authorizing `identity:create_grant(project_id=164a8167edb3454aac80d6dda070f6b9, user_id=6084f23e03f9492394bd2cad3f460dbc, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.568987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909749f-2105-418d-920b-9e70879f826f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.577371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.578034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.578320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.578597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.647456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 115/224] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:31:55 2022] PUT /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/6084f23e03f9492394bd2cad3f460dbc/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:55.649142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0d49-533b-45d4-8060-d9ebe44f44ac None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.650374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0d49-533b-45d4-8060-d9ebe44f44ac None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.650654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f0d49-533b-45d4-8060-d9ebe44f44ac None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.652232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 116/225] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:55.653645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.655156 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.658003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f0cd0-0af2-43ae-8bbc-b6f2b53db774 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.658286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f0cd0-0af2-43ae-8bbc-b6f2b53db774 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.658668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f0cd0-0af2-43ae-8bbc-b6f2b53db774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.680483 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d37f0cd0-0af2-43ae-8bbc-b6f2b53db774 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:55.681802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d37f0cd0-0af2-43ae-8bbc-b6f2b53db774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:55.755904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:55.778873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 117/226] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:31:55.795380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 110/227] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:31:55.801353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f0cd0-0af2-43ae-8bbc-b6f2b53db774 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.805559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.927749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:55.931954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f0cd0-0af2-43ae-8bbc-b6f2b53db774 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.944125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75c45b-cb25-437c-b473-7dbf90fa5f80 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:55.968937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.970185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.970560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.970895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:55.972181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:55.973746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:55.975788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 118/228] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:55 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:55.983135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:55.986907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:55.987999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:55.988512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:55.988976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:56.029443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:56.037905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:56.038817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:56.039616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 111/229] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:31:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:31:56.049950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:56.104326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7c692-1781-48d5-a148-e84001c1d598 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:56.115810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:56.146923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:56.147892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:56.148538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:56.150305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:56.151360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=5845871f828442f282adb4a14f6cc474) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:56.152653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:56.154371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:56.167359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 119/230] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:31:55 2022] GET /identity/v3/role_assignments?user.id=5845871f828442f282adb4a14f6cc474&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:31:56.248771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8b219-ce93-46fa-b01f-f585d050f8c6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:56.292158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:56.292950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:56.293151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:56.293469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:56.294284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:56.294598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:56.296060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:56.306428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 112/231] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:31:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:56.311910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:56.343079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:56.434440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f250b2b-9f38-432c-a7fa-a8e716bc80e9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:56.470962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:56.471834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:56.472103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:56.472380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] PATH_INFO: `/v3/users/6084f23e03f9492394bd2cad3f460dbc` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:56.473639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] RBAC: Authorizing `identity:get_user(user_id=6084f23e03f9492394bd2cad3f460dbc)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:56.475164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:56.476878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 120/232] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:56 2022] GET /identity/v3/users/6084f23e03f9492394bd2cad3f460dbc => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:56.482758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:56.617452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:56.629793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a31e-41f0-4347-9adb-e517e4652322 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:56.672074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556534ba-3bca-4955-9fe3-c1a264522478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:56.672968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556534ba-3bca-4955-9fe3-c1a264522478 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:56.673778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556534ba-3bca-4955-9fe3-c1a264522478 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:56.674053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556534ba-3bca-4955-9fe3-c1a264522478 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:56.675378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556534ba-3bca-4955-9fe3-c1a264522478 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:56.676937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556534ba-3bca-4955-9fe3-c1a264522478 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:56.678837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 113/233] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:56 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:56.684388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:56.811497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:56.819031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511cb695-d9a8-4f77-acef-4da123766371 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:56.865534 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023831af-0513-4f5b-b28f-6a13df0ab755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:56.866425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023831af-0513-4f5b-b28f-6a13df0ab755 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:56.866708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023831af-0513-4f5b-b28f-6a13df0ab755 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:56.866985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023831af-0513-4f5b-b28f-6a13df0ab755 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/6084f23e03f9492394bd2cad3f460dbc/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:56.870254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023831af-0513-4f5b-b28f-6a13df0ab755 None admin] RBAC: Authorizing `identity:create_grant(project_id=164a8167edb3454aac80d6dda070f6b9, user_id=6084f23e03f9492394bd2cad3f460dbc, role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:56.871694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023831af-0513-4f5b-b28f-6a13df0ab755 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:56.973243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 121/234] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:31:56 2022] PUT /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/6084f23e03f9492394bd2cad3f460dbc/roles/6fcb971d81654e48875c8cd12e298a9e => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:31:58.404111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760012f-c0a8-4bfd-bf37-7cb6b86f63ab None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.404694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760012f-c0a8-4bfd-bf37-7cb6b86f63ab None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.404694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760012f-c0a8-4bfd-bf37-7cb6b86f63ab None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.406213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 114/235] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:58.407182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de8ed4-079b-471c-b9f3-95b5adde353a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.407499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de8ed4-079b-471c-b9f3-95b5adde353a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.408313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de8ed4-079b-471c-b9f3-95b5adde353a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.409816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 115/236] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:58.411225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ac1c-fbf2-489e-a510-bed40e4e6df2 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.411616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ac1c-fbf2-489e-a510-bed40e4e6df2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.411795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902ac1c-fbf2-489e-a510-bed40e4e6df2 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.413165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 122/237] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:58.415100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa60ba-68d7-43ea-b0a8-b4d8e0986fd2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.415392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa60ba-68d7-43ea-b0a8-b4d8e0986fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.415673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa60ba-68d7-43ea-b0a8-b4d8e0986fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.418518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45dbf9-4f5b-44af-902e-1791726c5d35 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.418518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45dbf9-4f5b-44af-902e-1791726c5d35 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.418709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45dbf9-4f5b-44af-902e-1791726c5d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.434500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-74fa60ba-68d7-43ea-b0a8-b4d8e0986fd2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:58.435218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3e45dbf9-4f5b-44af-902e-1791726c5d35 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:58.436207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-74fa60ba-68d7-43ea-b0a8-b4d8e0986fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:58.436385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3e45dbf9-4f5b-44af-902e-1791726c5d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:58.513651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 116/238] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:58.515513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14880-1e08-4ccd-8dd1-0753e757dd7a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.516015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14880-1e08-4ccd-8dd1-0753e757dd7a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.516590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d14880-1e08-4ccd-8dd1-0753e757dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.516715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 123/239] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:58.542214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-52d14880-1e08-4ccd-8dd1-0753e757dd7a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:58.543692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-52d14880-1e08-4ccd-8dd1-0753e757dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:58.551134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45dbf9-4f5b-44af-902e-1791726c5d35 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:58.640436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 117/240] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:58.641773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14880-1e08-4ccd-8dd1-0753e757dd7a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:58.657160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:58.674996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:58.682569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45dbf9-4f5b-44af-902e-1791726c5d35 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:58.729963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:58.731151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.731443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.731728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.747112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:58.758682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:58.759609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:31:58.760386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:31:58.764487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 124/241] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:58.768474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d14880-1e08-4ccd-8dd1-0753e757dd7a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:58.768984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:58.806389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:58.807244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.807537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.807820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.819513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:58.828528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:58.831448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 118/242] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:58.833410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:58.884005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b399c-55aa-4a3e-843a-ab1ce7ff00e4 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:58.920363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:58.921114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.921404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.921752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.922956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:58.924629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:58.926280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 125/243] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:58.927055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:58.930756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:58.943301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:58.951686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac2333e-2476-4677-b65c-7817181efe8a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:58.990653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:58.991328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:58.991619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:58.991900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:58.992689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:58.993001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:58.994402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.003412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 119/244] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:59.004360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.038281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f2296-1aee-4f0c-bca7-fedd97701cf8 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.073608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.074287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.074577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.074862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.075620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:31:59.075932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:59.077344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.086575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 126/245] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:59.087405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.115293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66343966-e6a7-443a-b70a-5b00e3bebd57 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.154131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa4c5e-ce71-4a7e-ad80-ef2f506b1eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.154811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa4c5e-ce71-4a7e-ad80-ef2f506b1eac None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.155105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa4c5e-ce71-4a7e-ad80-ef2f506b1eac None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.155387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa4c5e-ce71-4a7e-ad80-ef2f506b1eac None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.156102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa4c5e-ce71-4a7e-ad80-ef2f506b1eac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:59.158392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa4c5e-ce71-4a7e-ad80-ef2f506b1eac None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.169471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.192233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca15a9-88b6-4a83-a884-a236d6a2b722 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.226461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.227367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.227667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.227985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] PATH_INFO: `/v3/users/6084f23e03f9492394bd2cad3f460dbc` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.229223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] RBAC: Authorizing `identity:get_user(user_id=6084f23e03f9492394bd2cad3f460dbc)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:59.230669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.232599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 127/246] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/users/6084f23e03f9492394bd2cad3f460dbc => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:59.233366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.286878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.292472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 120/247] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:31:59 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:31:59.293775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb54cb1-18e7-4baa-b40a-5707bdd7f4fc None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.294071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb54cb1-18e7-4baa-b40a-5707bdd7f4fc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.294498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb54cb1-18e7-4baa-b40a-5707bdd7f4fc None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.300299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 121/248] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:59.300299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb54cb1-18e7-4baa-b40a-5707bdd7f4fc None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.366529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e435f49-fe38-4cbb-9908-d8b6264783eb None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.415425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd546b42-9036-476f-8240-aea186e8d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.417398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd546b42-9036-476f-8240-aea186e8d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.418171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd546b42-9036-476f-8240-aea186e8d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.418609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd546b42-9036-476f-8240-aea186e8d4a9 None admin] PATH_INFO: `/v3/users/dd058cc90bba4090925586fd33fe71f2` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.437505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb54cb1-18e7-4baa-b40a-5707bdd7f4fc None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.438238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd546b42-9036-476f-8240-aea186e8d4a9 None admin] RBAC: Authorizing `identity:get_user(user_id=dd058cc90bba4090925586fd33fe71f2)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:59.440592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd546b42-9036-476f-8240-aea186e8d4a9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.444814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 128/249] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/users/dd058cc90bba4090925586fd33fe71f2 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:31:59.446031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19035f-bbc1-4bc1-9fdd-986538a4f0d2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.446497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19035f-bbc1-4bc1-9fdd-986538a4f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.446929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19035f-bbc1-4bc1-9fdd-986538a4f0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.453643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.470616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ce19035f-bbc1-4bc1-9fdd-986538a4f0d2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:31:59.472623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ce19035f-bbc1-4bc1-9fdd-986538a4f0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:31:59.492690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.493655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.494006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.494402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.563143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 129/250] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:31:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:31:59.565135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19035f-bbc1-4bc1-9fdd-986538a4f0d2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.583377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.586032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:59.587635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.693673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19035f-bbc1-4bc1-9fdd-986538a4f0d2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.703419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 122/251] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:59.704088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.733918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.743669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b8e45-1992-4576-8f30-30627a328a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.744389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b8e45-1992-4576-8f30-30627a328a7b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.748128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b8e45-1992-4576-8f30-30627a328a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.748128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b8e45-1992-4576-8f30-30627a328a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.837581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:31:59.837767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b8e45-1992-4576-8f30-30627a328a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:31:59.839180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b8e45-1992-4576-8f30-30627a328a7b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:31:59.842277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88a6a4-9344-44e2-a52f-58bac7a10ce1 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:31:59.885507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:31:59.886911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.887855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.888482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.902527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:31:59.912269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:31:59.913183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:31:59.914000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 123/252] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:31:59.919952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.956614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 130/253] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:31:59.958109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8911-90cb-4aa8-9c86-41a4b53bda01 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:31:59.958400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8911-90cb-4aa8-9c86-41a4b53bda01 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:31:59.958678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc8911-90cb-4aa8-9c86-41a4b53bda01 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:31:59.959954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 131/254] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:31:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:31:59.960843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc8911-90cb-4aa8-9c86-41a4b53bda01 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:31:59.995918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:00.031451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dead1f5-13f1-4dee-b61a-a23228e7872c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.068611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a033ed2-eb55-4f10-8d87-0debeee670d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.070113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033ed2-eb55-4f10-8d87-0debeee670d7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.070600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc8911-90cb-4aa8-9c86-41a4b53bda01 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.070827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033ed2-eb55-4f10-8d87-0debeee670d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.071322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a033ed2-eb55-4f10-8d87-0debeee670d7 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.072978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a033ed2-eb55-4f10-8d87-0debeee670d7 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:00.074651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a033ed2-eb55-4f10-8d87-0debeee670d7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:00.076888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 124/255] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:00.078344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60b12-c7df-4f2a-b18a-f3749d06b2da None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.078857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60b12-c7df-4f2a-b18a-f3749d06b2da None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.079395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f60b12-c7df-4f2a-b18a-f3749d06b2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.097898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-50f60b12-c7df-4f2a-b18a-f3749d06b2da None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:00.099421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-50f60b12-c7df-4f2a-b18a-f3749d06b2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:00.113037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.113682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.114016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.114295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.115107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:00.115419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:00.116976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:00.124852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:00.126006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 132/256] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:31:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:00.131376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.188766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 125/257] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:00.189771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f60b12-c7df-4f2a-b18a-f3749d06b2da None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.270506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e05d7-e44a-4977-a248-d96ad1a76d55 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.272714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:00.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.315604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.316330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.316775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.318820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:00.320890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:00.323081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 133/258] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:00.324010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.342477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f60b12-c7df-4f2a-b18a-f3749d06b2da None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.388115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.389224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.389657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.390408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.391696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=6084f23e03f9492394bd2cad3f460dbc) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:00.393011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:00.395200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:00.403519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 126/259] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/role_assignments?user.id=6084f23e03f9492394bd2cad3f460dbc&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:00.404547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.436884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:00.495423 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198384cc-ba5b-40cb-b4d6-c3754a62fe2d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.527243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab82d5-0215-43b2-951e-793f41a62f25 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.570013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.571243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.571733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.572230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.585894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:00.595524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:00.596914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:00.597795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:00.600545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 127/260] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:00.601601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.633720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.634641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.634978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.635292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] PATH_INFO: `/v3/users/5845871f828442f282adb4a14f6cc474` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.641608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] RBAC: Authorizing `identity:get_user(user_id=5845871f828442f282adb4a14f6cc474)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:00.643405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:00.651993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 134/261] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/users/5845871f828442f282adb4a14f6cc474 => generated 297 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:00.652827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.724661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:00.724854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:00.741215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82b5b32-3c58-45dc-b170-f6034dae4b79 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.784547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.784919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.785207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.785489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.786393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] RBAC: Adding query filter params (role.id=2bf5c7868b6d43a183e4de9ee1aee25c, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=dd058cc90bba4090925586fd33fe71f2) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:00.786744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:00.788339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:00.798977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 128/262] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/role_assignments?user.id=dd058cc90bba4090925586fd33fe71f2&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=2bf5c7868b6d43a183e4de9ee1aee25c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:00.799848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.841418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d24ee-fb32-4123-b02a-395fce7eb746 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:00.908913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:00.909605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:00.909889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:00.910162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:00.910931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:00.911294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:00.912756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:00.933050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 135/263] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:00.940261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:00.977990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3324940-e840-4d84-9a57-a21c9433cd68 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:01.055078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:01.055874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:01.056155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:01.056447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:01.057764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:01.059243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:01.061188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 129/264] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:01.068261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:01.096781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:01.129301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:01.139456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7980aba3-8caa-40bd-855c-ab1b5ac5bfcc None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:01.180761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:01.182047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:01.182495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:01.182934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] PATH_INFO: `/v3/users/6084f23e03f9492394bd2cad3f460dbc` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:01.184296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] RBAC: Authorizing `identity:get_user(user_id=6084f23e03f9492394bd2cad3f460dbc)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:01.186284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:01.188467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 136/265] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:00 2022] GET /identity/v3/users/6084f23e03f9492394bd2cad3f460dbc => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:01.194299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:01.246409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ef12e-c41a-4e63-aea4-8d155c976a71 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:01.338910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:01.339732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:01.340021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:01.340305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/5845871f828442f282adb4a14f6cc474/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:01.344385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] RBAC: Authorizing `identity:create_grant(project_id=164a8167edb3454aac80d6dda070f6b9, user_id=5845871f828442f282adb4a14f6cc474, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:01.345976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:01.358479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62ef2d-1015-406c-9f3b-86ea80357e14 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:01.398280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:01.399366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:01.399880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:01.400389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:01.431661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:01.449941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 130/266] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:32:01 2022] PUT /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/5845871f828442f282adb4a14f6cc474/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:01.504731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:01.506398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:01.645923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 137/267] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:01.651827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:01.736005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:01.771834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03f675-11cf-44b5-ab23-39056a2d9916 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:01.817221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8e92b-cae9-4ba3-bc5e-0f7d12f6ee57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:01.818532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e92b-cae9-4ba3-bc5e-0f7d12f6ee57 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:01.819055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e92b-cae9-4ba3-bc5e-0f7d12f6ee57 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:01.819528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8e92b-cae9-4ba3-bc5e-0f7d12f6ee57 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:01.821368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e92b-cae9-4ba3-bc5e-0f7d12f6ee57 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:01.823152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8e92b-cae9-4ba3-bc5e-0f7d12f6ee57 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:01.825245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 131/268] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:01 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:01.837621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:01.918488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:01.973360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16e790-73bc-4e8f-9526-4aa6ffa36f1d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:02.021804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de0557-e1df-4661-a0d6-6424fea1cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:02.022805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de0557-e1df-4661-a0d6-6424fea1cb16 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.023312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de0557-e1df-4661-a0d6-6424fea1cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.023799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de0557-e1df-4661-a0d6-6424fea1cb16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.024882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de0557-e1df-4661-a0d6-6424fea1cb16 None admin] RBAC: Adding query filter params (role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=6084f23e03f9492394bd2cad3f460dbc) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:02.025395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de0557-e1df-4661-a0d6-6424fea1cb16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:02.027028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de0557-e1df-4661-a0d6-6424fea1cb16 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:02.034145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 138/269] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:01 2022] GET /identity/v3/role_assignments?user.id=6084f23e03f9492394bd2cad3f460dbc&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:02.101558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db57c-a057-4045-86b1-0a067920cdec None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.101903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db57c-a057-4045-86b1-0a067920cdec None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.102128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151db57c-a057-4045-86b1-0a067920cdec None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.103563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 132/270] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:02.109745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29ace-0d50-44d7-8181-f1195d9f6d96 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.110204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29ace-0d50-44d7-8181-f1195d9f6d96 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.111163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29ace-0d50-44d7-8181-f1195d9f6d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.129491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-68b29ace-0d50-44d7-8181-f1195d9f6d96 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:02.130727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-68b29ace-0d50-44d7-8181-f1195d9f6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:02.260394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 139/271] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:02.296955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6981a-c103-4b54-99ae-70b2f26a680d None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.297260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6981a-c103-4b54-99ae-70b2f26a680d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.297535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6981a-c103-4b54-99ae-70b2f26a680d None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.299173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 133/272] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:02.306782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6981a-c103-4b54-99ae-70b2f26a680d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:02.314421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f463c2-9602-4a8e-a0c3-eb52e86d0c36 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.314977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f463c2-9602-4a8e-a0c3-eb52e86d0c36 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.315461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f463c2-9602-4a8e-a0c3-eb52e86d0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.340635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f3f463c2-9602-4a8e-a0c3-eb52e86d0c36 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:02.342226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f3f463c2-9602-4a8e-a0c3-eb52e86d0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:02.418682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:02.436759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6981a-c103-4b54-99ae-70b2f26a680d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:02.446392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 140/273] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:02.474961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f463c2-9602-4a8e-a0c3-eb52e86d0c36 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:02.478048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:02.479761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.480051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.480338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.481835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:02.483336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:02.485187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 134/274] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:02.493995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:02.516920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:02.601599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f463c2-9602-4a8e-a0c3-eb52e86d0c36 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:02.634630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2ea838-2e89-4c85-8324-ae31dd6d9fb9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:02.640473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:02.641350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.642228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.642619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.654030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:02.662444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:02.664219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:02.665739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 141/275] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:02.671050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:02.679993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:02.680691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.680980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.681784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.682561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:02.684559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:02.724625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:02.780949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a39d14-411b-4c9f-bda3-e2bfeff9717d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:02.802375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 135/276] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:32:02 2022] POST /identity/v3/users => generated 293 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:32:02.829104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:02.830272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:02.830482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:02.830761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:02.831607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:02.831924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:02.833483 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:02.844166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 142/277] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:02.850867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:02.928108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:02.972417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0ce8e-608c-452d-aad1-d305caaee3c8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:03.011744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60838a61-d130-4907-be74-d5075dcfaf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:03.012669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60838a61-d130-4907-be74-d5075dcfaf3d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:03.012956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60838a61-d130-4907-be74-d5075dcfaf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:03.013233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60838a61-d130-4907-be74-d5075dcfaf3d None admin] PATH_INFO: `/v3/users/93f40ced538d44c4a6f45f9364638299` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:03.030252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60838a61-d130-4907-be74-d5075dcfaf3d None admin] RBAC: Authorizing `identity:get_user(user_id=93f40ced538d44c4a6f45f9364638299)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:03.031855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60838a61-d130-4907-be74-d5075dcfaf3d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:03.034415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 136/278] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:02 2022] GET /identity/v3/users/93f40ced538d44c4a6f45f9364638299 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:03.040041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:03.150872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b536e-0e97-4e6f-92a0-393dc903a931 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:03.159120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:03.188041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82244e86-2002-438b-8dfa-bfff3334bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:03.189418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82244e86-2002-438b-8dfa-bfff3334bb03 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:03.189553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82244e86-2002-438b-8dfa-bfff3334bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:03.189831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82244e86-2002-438b-8dfa-bfff3334bb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:03.190683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82244e86-2002-438b-8dfa-bfff3334bb03 None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, user.id=93f40ced538d44c4a6f45f9364638299, scope.system=all) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:03.191061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82244e86-2002-438b-8dfa-bfff3334bb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:03.192558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82244e86-2002-438b-8dfa-bfff3334bb03 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:03.198764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 143/279] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 2 13:32:03 2022] GET /identity/v3/role_assignments?user.id=93f40ced538d44c4a6f45f9364638299&scope.system=all&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:03.568985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f109-2d32-4ecf-aad1-ea9bc0058839 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:03.569277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f109-2d32-4ecf-aad1-ea9bc0058839 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:03.569733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6688f109-2d32-4ecf-aad1-ea9bc0058839 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:03.571531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 137/280] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:03.577335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a884f-86a6-4304-917c-2631aefc901e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:03.577902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a884f-86a6-4304-917c-2631aefc901e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:03.578408 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a884f-86a6-4304-917c-2631aefc901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:03.605426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-963a884f-86a6-4304-917c-2631aefc901e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:03.607784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-963a884f-86a6-4304-917c-2631aefc901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:03.726824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 144/281] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:03.778027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f109-2d32-4ecf-aad1-ea9bc0058839 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:03.926036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6688f109-2d32-4ecf-aad1-ea9bc0058839 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:03.972766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:03.985212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5a8e2-a582-485d-8f32-1b97ed20b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:03.993383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a8e2-a582-485d-8f32-1b97ed20b806 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:03.993383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a8e2-a582-485d-8f32-1b97ed20b806 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:03.993383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5a8e2-a582-485d-8f32-1b97ed20b806 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.008175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5a8e2-a582-485d-8f32-1b97ed20b806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-94c5a8e2-a582-485d-8f32-1b97ed20b806 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:04.015873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:04.017094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:04.018024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 138/282] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:04.023494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a884f-86a6-4304-917c-2631aefc901e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:04.040575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54f742-7ec2-487d-bb0d-82794dcc051f None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.040885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54f742-7ec2-487d-bb0d-82794dcc051f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.041071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54f742-7ec2-487d-bb0d-82794dcc051f None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.042427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 139/283] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:04.057893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e4f9c-44a0-4a96-a72d-bb47c5709d6a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.058227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e4f9c-44a0-4a96-a72d-bb47c5709d6a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.058456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e4f9c-44a0-4a96-a72d-bb47c5709d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.091734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-cb2e4f9c-44a0-4a96-a72d-bb47c5709d6a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:04.092951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-cb2e4f9c-44a0-4a96-a72d-bb47c5709d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:04.135877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a884f-86a6-4304-917c-2631aefc901e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:04.144747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:04.181311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:04.183444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.184890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.186004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.187186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:04.188731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:04.191982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:04.208832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 145/284] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:04.214675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:04.251273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 140/285] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:04.274379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e4f9c-44a0-4a96-a72d-bb47c5709d6a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:04.395323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728b26a-8955-4c1e-80b7-a8c5ec2ed383 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:04.433715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:04.434986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.435487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.435982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] PATH_INFO: `/v3/users/dd058cc90bba4090925586fd33fe71f2` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.437506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] RBAC: Authorizing `identity:get_user(user_id=dd058cc90bba4090925586fd33fe71f2)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:04.439441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:04.441627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 146/286] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:04 2022] GET /identity/v3/users/dd058cc90bba4090925586fd33fe71f2 => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:04.455716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:04.467639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e4f9c-44a0-4a96-a72d-bb47c5709d6a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:04.492788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:04.507815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:04.542119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:04.543001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.543285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.543559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.573340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:04.588444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8aec5-b91a-4626-890a-42883440de65 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:04.589214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:04.590106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:04.590890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 141/287] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:04.597081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:04.636030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:04.637730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.638228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.638734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.640327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:04.642239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:04.650570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 147/288] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:04 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:04.659941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:04.756376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653bc2f-5d70-4d1e-bbad-e2e28bfa4fdc None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:04.778098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:04.783534 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf65e-c395-42ef-9ade-e70109fae32e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:04.817126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:04.817813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.818105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.818388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.819143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:04.819624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:04.821276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:04.831473 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 142/289] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:04.838659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:04.839542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:04.839876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:04.839997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:04.840252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/dd058cc90bba4090925586fd33fe71f2/roles/2bf5c7868b6d43a183e4de9ee1aee25c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:04.842265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=164a8167edb3454aac80d6dda070f6b9, user_id=dd058cc90bba4090925586fd33fe71f2, role_id=2bf5c7868b6d43a183e4de9ee1aee25c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:04.843715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:04.905501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:04.933153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 148/290] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:32:04 2022] PUT /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9/users/dd058cc90bba4090925586fd33fe71f2/roles/2bf5c7868b6d43a183e4de9ee1aee25c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:04.960846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb717f-5318-44c1-860e-7f8c9be186c3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:05.004207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:05.005229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.005523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.005804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] PATH_INFO: `/v3/users/5845871f828442f282adb4a14f6cc474` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.009392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] RBAC: Authorizing `identity:get_user(user_id=5845871f828442f282adb4a14f6cc474)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:05.010925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:05.013162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 143/291] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:04 2022] GET /identity/v3/users/5845871f828442f282adb4a14f6cc474 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:05.019351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:05.181467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e26497-b644-4942-bbc9-945914ce8bb1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:05.234170 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:05.234973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.235257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.235695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.282005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:05.341709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:05.343178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:05.470195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 149/292] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:05.476068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:05.624770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309125a-a069-4e5d-a572-aa2d9af131bf None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:05.627458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:05.667430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54ad54-9fc8-4c5b-b71e-a9c217aede04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:05.668295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ad54-9fc8-4c5b-b71e-a9c217aede04 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.668602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ad54-9fc8-4c5b-b71e-a9c217aede04 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.668878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54ad54-9fc8-4c5b-b71e-a9c217aede04 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.670064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ad54-9fc8-4c5b-b71e-a9c217aede04 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:05.671586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54ad54-9fc8-4c5b-b71e-a9c217aede04 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:05.673970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 144/293] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:05 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:05.679898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:05.758613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:05.769805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d59c-ce80-4ed4-b82a-5873bddffa9c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.770138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d59c-ce80-4ed4-b82a-5873bddffa9c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.770364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2d59c-ce80-4ed4-b82a-5873bddffa9c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.772098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 145/294] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:05.783548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567a45-d8fd-451d-a7e7-0a6a3e418d3a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.783871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567a45-d8fd-451d-a7e7-0a6a3e418d3a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.784116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62567a45-d8fd-451d-a7e7-0a6a3e418d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.806717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-62567a45-d8fd-451d-a7e7-0a6a3e418d3a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:05.807903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-62567a45-d8fd-451d-a7e7-0a6a3e418d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:05.832946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d37b5-2feb-4c3e-9cf6-3807b03f3c3d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:05.885188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced68b2-7c86-4a24-a177-e4e364d5c843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:05.886278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced68b2-7c86-4a24-a177-e4e364d5c843 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.886579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced68b2-7c86-4a24-a177-e4e364d5c843 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.886866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced68b2-7c86-4a24-a177-e4e364d5c843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.887991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced68b2-7c86-4a24-a177-e4e364d5c843 None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=5845871f828442f282adb4a14f6cc474) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:05.888315 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced68b2-7c86-4a24-a177-e4e364d5c843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:05.889795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced68b2-7c86-4a24-a177-e4e364d5c843 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:05.892003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 146/295] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:05.894144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64aa6-a16c-4f60-9073-77c71a5096e9 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.894640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64aa6-a16c-4f60-9073-77c71a5096e9 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.895126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64aa6-a16c-4f60-9073-77c71a5096e9 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.896878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 150/296] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:05 2022] GET /identity/v3/role_assignments?user.id=5845871f828442f282adb4a14f6cc474&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:05.897240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 147/297] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:05.910231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829db2cc-178a-493a-a685-13c7c9351df3 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:05.910573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829db2cc-178a-493a-a685-13c7c9351df3 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:05.910800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829db2cc-178a-493a-a685-13c7c9351df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:05.914991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64aa6-a16c-4f60-9073-77c71a5096e9 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:05.939605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-829db2cc-178a-493a-a685-13c7c9351df3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:05.940883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-829db2cc-178a-493a-a685-13c7c9351df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:06.038724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:06.044609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64aa6-a16c-4f60-9073-77c71a5096e9 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.089322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.090532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.091024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.091493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.093005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:06.095713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:06.098201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 148/298] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:06.109402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.134050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 151/299] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:06.165023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829db2cc-178a-493a-a685-13c7c9351df3 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.228923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:06.229888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21112-7da0-4784-89bc-9eec748af4bf None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.276210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d964c7-b072-4299-a67d-2b0eef151d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.277375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d964c7-b072-4299-a67d-2b0eef151d2d None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.277668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d964c7-b072-4299-a67d-2b0eef151d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.277948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d964c7-b072-4299-a67d-2b0eef151d2d None admin] PATH_INFO: `/v3/groups` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.278934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d964c7-b072-4299-a67d-2b0eef151d2d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:06.281251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d964c7-b072-4299-a67d-2b0eef151d2d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:06.293563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829db2cc-178a-493a-a685-13c7c9351df3 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.331611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5381cc3-baa4-4f41-a61c-85d92afbc1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.332503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381cc3-baa4-4f41-a61c-85d92afbc1bc None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.332796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381cc3-baa4-4f41-a61c-85d92afbc1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.333084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5381cc3-baa4-4f41-a61c-85d92afbc1bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.344050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5381cc3-baa4-4f41-a61c-85d92afbc1bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-c5381cc3-baa4-4f41-a61c-85d92afbc1bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:06.351762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:06.352697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:06.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 152/300] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:06.354512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc863d-41d0-4f35-8731-842f9720a02c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.354512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc863d-41d0-4f35-8731-842f9720a02c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.354903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fc863d-41d0-4f35-8731-842f9720a02c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.356457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 153/301] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:06.363975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc863d-41d0-4f35-8731-842f9720a02c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.376886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 149/302] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Jun 2 13:32:06 2022] POST /identity/v3/groups => generated 229 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:06.376886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f06b9-9d64-427e-97ca-780a6fc06dcc None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.376886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f06b9-9d64-427e-97ca-780a6fc06dcc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.376886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9f06b9-9d64-427e-97ca-780a6fc06dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.386623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-9b9f06b9-9d64-427e-97ca-780a6fc06dcc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:06.387849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9b9f06b9-9d64-427e-97ca-780a6fc06dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:06.414961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:06.472861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 150/303] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:06.493707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f06b9-9d64-427e-97ca-780a6fc06dcc None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.517115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fc863d-41d0-4f35-8731-842f9720a02c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.536942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:06.569281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.570126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.570417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.570698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.572500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:06.572500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:06.574884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:06.586188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 154/304] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:06.591750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.611428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9f06b9-9d64-427e-97ca-780a6fc06dcc None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.657996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.659624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.660205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.661325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.679463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:06.690580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:06.691564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:06.692385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:06.693921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 151/305] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:06.700629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.714171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f1c8-d406-4635-9067-62595967dac3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.721468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:06.753299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.754539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.755103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.755630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] PATH_INFO: `/v3/users/541c694f606f4de3b79041d6f5261f5d` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.770781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] RBAC: Authorizing `identity:get_user(user_id=541c694f606f4de3b79041d6f5261f5d)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:06.772721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:06.775172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 155/306] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/users/541c694f606f4de3b79041d6f5261f5d => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:06.780444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.809137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb23178-dff7-4e9e-89f5-839e7f36d4b4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.816651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:06.847460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.848051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.848339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.848670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.849540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] RBAC: Adding query filter params (name=member) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:06.849856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:06.851353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:06.860963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 152/307] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:06.866506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:06.898420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252403e-02ac-4dc0-a1c6-c1075f983c42 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:06.936728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:06.937759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:06.938358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:06.939458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:06.940738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] RBAC: Adding query filter params (role.id=2bf5c7868b6d43a183e4de9ee1aee25c, user.id=541c694f606f4de3b79041d6f5261f5d, scope.system=all) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:06.941264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:06.943005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:06.949251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 156/308] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/role_assignments?user.id=541c694f606f4de3b79041d6f5261f5d&scope.system=all&role.id=2bf5c7868b6d43a183e4de9ee1aee25c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:06.960859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:06.979003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1a8359-c971-4ee2-9bc9-0545bbadf809 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:07.018427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77392d1-f129-4132-847d-6393e642636f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:07.019331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77392d1-f129-4132-847d-6393e642636f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:07.019624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77392d1-f129-4132-847d-6393e642636f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:07.019905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77392d1-f129-4132-847d-6393e642636f None admin] PATH_INFO: `/v3/users/93f40ced538d44c4a6f45f9364638299` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:07.021463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77392d1-f129-4132-847d-6393e642636f None admin] RBAC: Authorizing `identity:get_user(user_id=93f40ced538d44c4a6f45f9364638299)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:07.022963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77392d1-f129-4132-847d-6393e642636f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:07.024912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 153/309] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:06 2022] GET /identity/v3/users/93f40ced538d44c4a6f45f9364638299 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:07.030513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:07.143427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:07.149087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0d91f-af0c-411c-a9de-751546cf1e22 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:07.184693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2daf67-cb99-4754-9904-e328fce1f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:07.185610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2daf67-cb99-4754-9904-e328fce1f4c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:07.185893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2daf67-cb99-4754-9904-e328fce1f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:07.186229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2daf67-cb99-4754-9904-e328fce1f4c7 None admin] PATH_INFO: `/v3/system/users/93f40ced538d44c4a6f45f9364638299/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:07.187775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2daf67-cb99-4754-9904-e328fce1f4c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=93f40ced538d44c4a6f45f9364638299, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:07.189497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2daf67-cb99-4754-9904-e328fce1f4c7 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:07.287135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 157/310] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Jun 2 13:32:07 2022] PUT /identity/v3/system/users/93f40ced538d44c4a6f45f9364638299/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:07.826655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a505-065a-4d0a-9cc3-e55e61f6f998 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:07.826847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a505-065a-4d0a-9cc3-e55e61f6f998 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:07.827130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3a505-065a-4d0a-9cc3-e55e61f6f998 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:07.828746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 154/311] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:07.834127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a64e-ae4d-47e8-8949-32bd81853ee0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:07.834566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a64e-ae4d-47e8-8949-32bd81853ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:07.834660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a64e-ae4d-47e8-8949-32bd81853ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:07.851522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c0d0a64e-ae4d-47e8-8949-32bd81853ee0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:07.852712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c0d0a64e-ae4d-47e8-8949-32bd81853ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:07.925311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 158/312] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:07.949426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3a505-065a-4d0a-9cc3-e55e61f6f998 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:08.055577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3a505-065a-4d0a-9cc3-e55e61f6f998 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:08.090344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:08.091056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:08.091339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:08.091614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:08.103926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:08.112367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:08.113341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:08.114142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 155/313] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:08.120038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a64e-ae4d-47e8-8949-32bd81853ee0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:08.216742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:08.228114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a64e-ae4d-47e8-8949-32bd81853ee0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:08.263634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:08.264314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:08.264632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:08.264916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:08.265667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:08.265978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:08.267612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:08.276046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 159/314] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:08.281921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:08.294650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:08.387859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40744a31-59f7-4c3a-a4d9-dfa9e29c00c2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:08.422428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:08.424077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:08.424279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:08.424474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] PATH_INFO: `/v3/users/dd058cc90bba4090925586fd33fe71f2` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:08.425681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] RBAC: Authorizing `identity:get_user(user_id=dd058cc90bba4090925586fd33fe71f2)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:08.427152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:08.429125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 156/315] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:08 2022] GET /identity/v3/users/dd058cc90bba4090925586fd33fe71f2 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:08.434403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:08.548792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412ec57-189e-4776-83f5-bf857f0d1a52 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:08.583603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad10f60-b02e-472a-bbf1-c735760e573a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:08.584255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad10f60-b02e-472a-bbf1-c735760e573a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:08.584567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad10f60-b02e-472a-bbf1-c735760e573a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:08.584847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad10f60-b02e-472a-bbf1-c735760e573a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:08.612882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:08.666245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad10f60-b02e-472a-bbf1-c735760e573a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:08.667608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad10f60-b02e-472a-bbf1-c735760e573a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:08.771824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 160/316] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:08.777490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:08.861295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:08.890579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948a68e-0600-420e-b2e9-646d930c6fc0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:08.909865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0df8fc-5a2a-445f-a0f6-3e903da3afd6 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:08.910516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0df8fc-5a2a-445f-a0f6-3e903da3afd6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:08.910516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0df8fc-5a2a-445f-a0f6-3e903da3afd6 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:08.912586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 161/317] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:08.919975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f263dc-7d5e-4f21-8656-64ef1f8d9383 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:08.920241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f263dc-7d5e-4f21-8656-64ef1f8d9383 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:08.920501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f263dc-7d5e-4f21-8656-64ef1f8d9383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:08.930726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:08.931617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:08.931907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:08.932190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:08.933554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:08.935073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:08.942464 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-12f263dc-7d5e-4f21-8656-64ef1f8d9383 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:08.942659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 157/318] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:08 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:08.943943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:08.944530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-12f263dc-7d5e-4f21-8656-64ef1f8d9383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:09.010139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:09.045244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 162/319] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:09.070760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46e41df-c193-4e4a-839e-c6608e238321 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:09.072748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f263dc-7d5e-4f21-8656-64ef1f8d9383 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:09.109344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:09.110496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.111626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.112102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.113158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] RBAC: Adding query filter params (role.id=2bf5c7868b6d43a183e4de9ee1aee25c, scope.project.id=164a8167edb3454aac80d6dda070f6b9, user.id=dd058cc90bba4090925586fd33fe71f2) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:09.113714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:09.115493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:09.122264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 158/320] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:08 2022] GET /identity/v3/role_assignments?user.id=dd058cc90bba4090925586fd33fe71f2&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=2bf5c7868b6d43a183e4de9ee1aee25c => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:09.191923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f263dc-7d5e-4f21-8656-64ef1f8d9383 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:09.231151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77c583-0bd5-4990-adaf-cf4312093d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:09.231971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77c583-0bd5-4990-adaf-cf4312093d5f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.232259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77c583-0bd5-4990-adaf-cf4312093d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.232583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77c583-0bd5-4990-adaf-cf4312093d5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.233855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77c583-0bd5-4990-adaf-cf4312093d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:09.236051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77c583-0bd5-4990-adaf-cf4312093d5f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:09.238137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 163/321] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:09.243999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:09.257369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:09.278358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c762ee-6dbc-4941-a0cb-f73ed0301cca None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.278995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c762ee-6dbc-4941-a0cb-f73ed0301cca None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.279639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c762ee-6dbc-4941-a0cb-f73ed0301cca None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.281653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 164/322] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:09.287970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ef8-18ae-4f5f-bd30-5a6ff0e6cdd5 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.288571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ef8-18ae-4f5f-bd30-5a6ff0e6cdd5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.288855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0218ef8-18ae-4f5f-bd30-5a6ff0e6cdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.316431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f0218ef8-18ae-4f5f-bd30-5a6ff0e6cdd5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:09.316431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f0218ef8-18ae-4f5f-bd30-5a6ff0e6cdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:09.379169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:09.389538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb70ac-e165-4817-a32c-cdbfb4853d14 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:09.405293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 165/323] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:09.428335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ef8-18ae-4f5f-bd30-5a6ff0e6cdd5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:09.435210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:09.435884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.436170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.436513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] PATH_INFO: `/v3/groups` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.437219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:09.439541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:09.525756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 159/324] 10.222.0.33 () {60 vars in 1134 bytes} [Thu Jun 2 13:32:09 2022] POST /identity/v3/groups => generated 226 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:09.536652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0218ef8-18ae-4f5f-bd30-5a6ff0e6cdd5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:09.570658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676b802-6998-45a0-95a5-8ff054a8b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:09.571460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676b802-6998-45a0-95a5-8ff054a8b9cb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.571744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676b802-6998-45a0-95a5-8ff054a8b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.572020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676b802-6998-45a0-95a5-8ff054a8b9cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.583836 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676b802-6998-45a0-95a5-8ff054a8b9cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-f676b802-6998-45a0-95a5-8ff054a8b9cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:09.591666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:09.592655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:09.593447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:09.596607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 166/325] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:09.599433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:09.678019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:09.715148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda48d2e-f670-4028-87e3-df8f37325c4b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:09.755739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16366a84-3b08-4531-9d55-15397645aaf9 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.755954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16366a84-3b08-4531-9d55-15397645aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.756234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16366a84-3b08-4531-9d55-15397645aaf9 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.757783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 167/326] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:09.762756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7264-ee3c-4254-92ae-398be435f1ea None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.763063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7264-ee3c-4254-92ae-398be435f1ea None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.763366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b7264-ee3c-4254-92ae-398be435f1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.764650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:09.766130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.767838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.767838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.770404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:09.770404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:09.770404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:09.779644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 160/327] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:09.781863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ab6b7264-ee3c-4254-92ae-398be435f1ea None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:09.783110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ab6b7264-ee3c-4254-92ae-398be435f1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:09.785819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:09.822568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:09.865976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 168/328] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:09.890424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b7264-ee3c-4254-92ae-398be435f1ea None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:09.914900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955cd84-19ad-4052-8f87-9ef4ed1e8872 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:09.948122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:09.960811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:09.961816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:09.962104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:09.962389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] PATH_INFO: `/v3/users/541c694f606f4de3b79041d6f5261f5d` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:09.963808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] RBAC: Authorizing `identity:get_user(user_id=541c694f606f4de3b79041d6f5261f5d)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:09.965345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:09.967210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 161/329] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:09 2022] GET /identity/v3/users/541c694f606f4de3b79041d6f5261f5d => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:09.975081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:10.037775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b7264-ee3c-4254-92ae-398be435f1ea None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:10.081343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:10.082407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:10.082899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:10.083345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:10.098482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:10.108162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:10.109304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:10.110120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:10.113252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 169/330] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:10.118759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:10.139770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22fc332-30ab-4649-9042-37308eb37375 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:10.165242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:10.192204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:10.193294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:10.195283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:10.195675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] PATH_INFO: `/v3/system/users/541c694f606f4de3b79041d6f5261f5d/roles/2bf5c7868b6d43a183e4de9ee1aee25c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:10.197414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=541c694f606f4de3b79041d6f5261f5d, role_id=2bf5c7868b6d43a183e4de9ee1aee25c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:10.199574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:10.268301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e4e880-5330-44bb-994f-a9f6a32548d0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:10.269712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 162/331] 10.222.0.33 () {58 vars in 1334 bytes} [Thu Jun 2 13:32:09 2022] PUT /identity/v3/system/users/541c694f606f4de3b79041d6f5261f5d/roles/2bf5c7868b6d43a183e4de9ee1aee25c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:10.312906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:10.313563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:10.314484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:10.314835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:10.315639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:10.316011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:10.317486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:10.331310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 170/332] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:10.336978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:10.420113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:10.484543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa086-586b-46ba-9689-25f1353aba2a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:10.535290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874b1bf-06e2-42f7-a328-07952958d6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:10.536239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874b1bf-06e2-42f7-a328-07952958d6da None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:10.536593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874b1bf-06e2-42f7-a328-07952958d6da None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:10.536877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874b1bf-06e2-42f7-a328-07952958d6da None admin] PATH_INFO: `/v3/users/93f40ced538d44c4a6f45f9364638299` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:10.538184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874b1bf-06e2-42f7-a328-07952958d6da None admin] RBAC: Authorizing `identity:get_user(user_id=93f40ced538d44c4a6f45f9364638299)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:10.539770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874b1bf-06e2-42f7-a328-07952958d6da None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:10.541474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 163/333] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:10 2022] GET /identity/v3/users/93f40ced538d44c4a6f45f9364638299 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:10.547332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:10.688476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:10.697418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6df6f3-fcc5-4e83-8b96-5a1e114e81c5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:10.746490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c117173-45bc-47a6-ab21-c64319671a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:10.747163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c117173-45bc-47a6-ab21-c64319671a5e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:10.747452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c117173-45bc-47a6-ab21-c64319671a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:10.747733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c117173-45bc-47a6-ab21-c64319671a5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:10.748616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c117173-45bc-47a6-ab21-c64319671a5e None admin] RBAC: Adding query filter params (role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, user.id=93f40ced538d44c4a6f45f9364638299, scope.system=all) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:10.748935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c117173-45bc-47a6-ab21-c64319671a5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:10.750395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c117173-45bc-47a6-ab21-c64319671a5e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:10.768303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 171/334] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 2 13:32:10 2022] GET /identity/v3/role_assignments?user.id=93f40ced538d44c4a6f45f9364638299&scope.system=all&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 510 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:12.343044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a09ad8-c689-4bb1-900d-166e448f43f1 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:12.343579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a09ad8-c689-4bb1-900d-166e448f43f1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:12.343579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a09ad8-c689-4bb1-900d-166e448f43f1 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:12.345929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 164/335] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:12.351171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2471f-b683-4a27-96d6-caa11b56ef02 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:12.351605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2471f-b683-4a27-96d6-caa11b56ef02 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:12.351729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2471f-b683-4a27-96d6-caa11b56ef02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:12.376641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-eef2471f-b683-4a27-96d6-caa11b56ef02 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:12.378126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eef2471f-b683-4a27-96d6-caa11b56ef02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:12.465803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 172/336] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:12.505321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a09ad8-c689-4bb1-900d-166e448f43f1 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:12.642357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a09ad8-c689-4bb1-900d-166e448f43f1 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:12.677163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:12.685770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:12.687103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:12.687586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:12.696711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:12.703367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:12.717881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:12.718768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:12.720272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:12.723435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 165/337] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:12.728898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2471f-b683-4a27-96d6-caa11b56ef02 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:12.856213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:12.876809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2471f-b683-4a27-96d6-caa11b56ef02 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:12.922490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3db42-f3a7-484a-b734-ebd05678abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:12.923712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3db42-f3a7-484a-b734-ebd05678abe3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:12.924009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3db42-f3a7-484a-b734-ebd05678abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:12.924295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3db42-f3a7-484a-b734-ebd05678abe3 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:12.925084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3db42-f3a7-484a-b734-ebd05678abe3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:12.925396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3db42-f3a7-484a-b734-ebd05678abe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:12.926789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3db42-f3a7-484a-b734-ebd05678abe3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:12.940560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 173/338] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:12.946464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:13.076449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda170-f235-4072-9fb7-ad9eef46307b None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:13.077167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda170-f235-4072-9fb7-ad9eef46307b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:13.077667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeda170-f235-4072-9fb7-ad9eef46307b None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:13.079929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 174/339] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:13.084424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581389f9-7e6e-49f3-a889-7d192004158b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:13.089809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b96b4-9d7a-4f17-a7cf-55f8cc505ef0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:13.090355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b96b4-9d7a-4f17-a7cf-55f8cc505ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:13.090839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b96b4-9d7a-4f17-a7cf-55f8cc505ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:13.114391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3b1b96b4-9d7a-4f17-a7cf-55f8cc505ef0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:13.115927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3b1b96b4-9d7a-4f17-a7cf-55f8cc505ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:13.133679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:13.134734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:13.135225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:13.135706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:13.237791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:13.264667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:13.266164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:13.273226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 175/340] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:13.312776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b96b4-9d7a-4f17-a7cf-55f8cc505ef0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:13.427323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 166/341] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:13.438638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:13.443210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:13.499549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b96b4-9d7a-4f17-a7cf-55f8cc505ef0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:13.585292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:13.586135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:13.586421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:13.586700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:13.617469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:13.626535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:13.627766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:13.631956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:13.634130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 176/342] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:13.640135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:13.640528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:13.664510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b4c4c-eb14-4349-8271-2af11f7f761f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:13.729195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:13.730166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:13.730765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:13.731044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:13.732438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:13.733931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:13.738465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 167/343] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:13 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:13.745958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:13.832635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c4115a-b8f5-43a5-8042-ad58d1f4521c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:13.884953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56392aa-18b3-4987-8b20-c483826a4e25 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:13.887234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:13.895990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:13.896711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:13.897003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:13.897286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:13.898200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:13.898518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:13.899927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:13.917332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 177/344] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:13.923715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:13.934419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:13.937365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:13.937885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:13.939074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:13.953190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:13.954844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:13.957797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 168/345] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:13 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:13.965632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:14.015725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.120211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711db349-1ae7-4ee7-abc1-e26ef72bb2ff None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:14.145165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d43086-71cc-4446-ade2-43a691b09cee None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:14.185744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd3aa8-2da0-49a5-9733-c04d7579c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:14.186779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3aa8-2da0-49a5-9733-c04d7579c919 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.187291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3aa8-2da0-49a5-9733-c04d7579c919 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.187773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3aa8-2da0-49a5-9733-c04d7579c919 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.200882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540087c4-7288-4210-bec1-4624f73e70b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:14.201545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540087c4-7288-4210-bec1-4624f73e70b9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.201835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540087c4-7288-4210-bec1-4624f73e70b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.202120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540087c4-7288-4210-bec1-4624f73e70b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.202958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540087c4-7288-4210-bec1-4624f73e70b9 None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=a7344bc63d8b4a1589024f667739a6b5) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:14.203268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540087c4-7288-4210-bec1-4624f73e70b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:14.205984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540087c4-7288-4210-bec1-4624f73e70b9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:14.212769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 169/346] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:13 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 260 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:14.216680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80015184-17aa-4305-ad58-c4ee67c1f97a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.216680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80015184-17aa-4305-ad58-c4ee67c1f97a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.216680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80015184-17aa-4305-ad58-c4ee67c1f97a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.216992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 170/347] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:14.218515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d978-af38-4ff9-9ab7-25da6881afd6 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.219034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d978-af38-4ff9-9ab7-25da6881afd6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.219453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18d978-af38-4ff9-9ab7-25da6881afd6 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.222913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 171/348] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:14.230133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6a8a2-228b-414b-8efc-75d0d72f7c9a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.230871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6a8a2-228b-414b-8efc-75d0d72f7c9a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.231320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6a8a2-228b-414b-8efc-75d0d72f7c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.265113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4bf6a8a2-228b-414b-8efc-75d0d72f7c9a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:14.266377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4bf6a8a2-228b-414b-8efc-75d0d72f7c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:14.294237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.306751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3aa8-2da0-49a5-9733-c04d7579c919 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:14.314784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd3aa8-2da0-49a5-9733-c04d7579c919 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:14.387493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 172/349] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:14.389101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a12c1-f59c-418b-9658-c7f897c6fa17 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.389389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a12c1-f59c-418b-9658-c7f897c6fa17 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.389666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a12c1-f59c-418b-9658-c7f897c6fa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.414685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0e0a12c1-f59c-418b-9658-c7f897c6fa17 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:14.418478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0e0a12c1-f59c-418b-9658-c7f897c6fa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:14.444431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.451434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 178/350] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:32:14.455714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb27d-5253-4450-95cc-169e354c7a28 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.457581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb27d-5253-4450-95cc-169e354c7a28 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.457581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93beb27d-5253-4450-95cc-169e354c7a28 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.457867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 179/351] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:14.460426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb27d-5253-4450-95cc-169e354c7a28 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:14.549702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 173/352] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:14.550712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a12c1-f59c-418b-9658-c7f897c6fa17 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:14.663336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.674663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93beb27d-5253-4450-95cc-169e354c7a28 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:14.746510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a12c1-f59c-418b-9658-c7f897c6fa17 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:14.755855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:14.755855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.756133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.756209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.789588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88372630-8f16-4e3c-bb2b-70bd33eb60d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:14.791015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88372630-8f16-4e3c-bb2b-70bd33eb60d2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.791525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88372630-8f16-4e3c-bb2b-70bd33eb60d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.791747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:14.792224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88372630-8f16-4e3c-bb2b-70bd33eb60d2 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.793692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88372630-8f16-4e3c-bb2b-70bd33eb60d2 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:14.795389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88372630-8f16-4e3c-bb2b-70bd33eb60d2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:14.798267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 174/353] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:14 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:14.799830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe80b9-b216-4cc0-80d1-8e350769904e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:14.800328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe80b9-b216-4cc0-80d1-8e350769904e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:14.805062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe80b9-b216-4cc0-80d1-8e350769904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:14.806777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:14.807690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:14.808591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:14.812784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 180/354] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:14.815028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:14.828491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0ebe80b9-b216-4cc0-80d1-8e350769904e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:14.830349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0ebe80b9-b216-4cc0-80d1-8e350769904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:14.843275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:14.961741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb58f13f-0498-4c3c-a3eb-c512b2e77e44 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:14.978282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 175/355] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:14.982598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe80b9-b216-4cc0-80d1-8e350769904e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.036523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.037437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.037798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.038150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.064781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:15.074654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:15.075672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:15.076505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 181/356] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:15.080714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.103979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:15.149266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe80b9-b216-4cc0-80d1-8e350769904e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.192915 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbfe57f-4db1-48ee-94b4-ea1407707da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.194407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe57f-4db1-48ee-94b4-ea1407707da0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.195686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe57f-4db1-48ee-94b4-ea1407707da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.195972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbfe57f-4db1-48ee-94b4-ea1407707da0 None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.198899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfe57f-4db1-48ee-94b4-ea1407707da0 None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:15.201921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbfe57f-4db1-48ee-94b4-ea1407707da0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:15.206924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 176/357] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:14 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:15.207176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90b045-a5cd-40e1-bbe6-934c39b9a51a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.207961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90b045-a5cd-40e1-bbe6-934c39b9a51a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.207961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90b045-a5cd-40e1-bbe6-934c39b9a51a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.209208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 177/358] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:15.214091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90b045-a5cd-40e1-bbe6-934c39b9a51a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.230117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:15.230785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cf6ad-b2e5-47e9-a515-bfbcfc095b41 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.284729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.286016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.286016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.286016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.286837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:15.287147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:15.288567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:15.298273 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 182/359] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:15.298875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.347362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90b045-a5cd-40e1-bbe6-934c39b9a51a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.393153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.394026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.394333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.394608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.399218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:15.406032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:15.414849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:15.415826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:15.416705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 178/360] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:15.417380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.431438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f9065-ef40-478f-97b7-7db09ace62ee None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.478798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e1f2c-efb2-402a-a29e-35abf0f5e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.479386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1f2c-efb2-402a-a29e-35abf0f5e299 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.479671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1f2c-efb2-402a-a29e-35abf0f5e299 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.479953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e1f2c-efb2-402a-a29e-35abf0f5e299 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.481006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e1f2c-efb2-402a-a29e-35abf0f5e299 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:15.481318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e1f2c-efb2-402a-a29e-35abf0f5e299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:15.482724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e1f2c-efb2-402a-a29e-35abf0f5e299 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:15.492461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 183/361] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:15.493621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0cabe-b95b-4e7d-a551-52156be3a33d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.493900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0cabe-b95b-4e7d-a551-52156be3a33d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.499915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0cabe-b95b-4e7d-a551-52156be3a33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.517359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-09c0cabe-b95b-4e7d-a551-52156be3a33d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:15.519006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-09c0cabe-b95b-4e7d-a551-52156be3a33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:15.524643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:15.565905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945f8d5-65ac-4dea-92f5-a91d6e35c5cb None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.595432 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 184/362] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:15.596108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0cabe-b95b-4e7d-a551-52156be3a33d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.605644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.606566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.607084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.607558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.608638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=a7344bc63d8b4a1589024f667739a6b5) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:15.609136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:15.611446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:15.617769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 179/363] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:15 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:15.624433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.669876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:15.712373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c0cabe-b95b-4e7d-a551-52156be3a33d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.746922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7dac87-c57c-4fd0-89e4-ec488cbbb833 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.774268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.774950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.775240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.775522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.812931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:15.814309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:15.814676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:15.814977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:15.815773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:15.816087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:15.817602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:15.820890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:15.831453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 180/364] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:15.832272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:15.884810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:15.887018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:15.959591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7aedd-9d44-400d-8a27-a79412c29e76 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:15.983264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:16.000909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:16.001776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:16.002064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:16.002395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] PATH_INFO: `/v3/users/541c694f606f4de3b79041d6f5261f5d` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:16.003621 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] RBAC: Authorizing `identity:get_user(user_id=541c694f606f4de3b79041d6f5261f5d)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:16.005202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:16.007061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 181/365] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:32:15 2022] GET /identity/v3/users/541c694f606f4de3b79041d6f5261f5d => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:16.016160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.023347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 185/366] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:16.024200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.108392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:16.158767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d701b64-ff31-4b3a-a97d-2fea3c28c1c6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:16.163684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd003e5-0a66-4e23-9da7-664dd1d88daa None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:16.202977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:16.204757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:16.205056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:16.205342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:16.209296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:16.210033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:16.210395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:16.210750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:16.218843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:16.229323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:16.230770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:16.231629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 182/367] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:16.232285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.254242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:16.301131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:16.303023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:16.385506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad760fc5-7b80-44f8-bf1b-b7141e92cc07 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:16.421328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:16.436184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:16.437324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:16.437809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:16.439008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:16.440069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] RBAC: Adding query filter params (role.id=2bf5c7868b6d43a183e4de9ee1aee25c, user.id=541c694f606f4de3b79041d6f5261f5d, scope.system=all) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:16.440612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:16.442384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:16.450501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 186/368] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:16.451815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.462007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 183/369] 10.222.0.33 () {56 vars in 1308 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/role_assignments?user.id=541c694f606f4de3b79041d6f5261f5d&scope.system=all&role.id=2bf5c7868b6d43a183e4de9ee1aee25c => generated 510 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:16.463188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.584374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:16.654324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecb0eb-bbba-4b2c-8bb4-2dc5e1f07d5c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:16.701884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4ec97-eea7-4638-aeca-471c1af3c3bb None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:16.725107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:16.726342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:16.726828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:16.727305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:16.729146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:16.731128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:16.736919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 187/370] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:16.738388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.801141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:16.801831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:16.802120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:16.802405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:16.803169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:16.803481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:16.804916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:16.821519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 184/371] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:16.822486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.878375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d63c1-38e7-40ef-b4b3-99cec1527d4a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:16.893434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:16.923563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:16.924886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:16.925377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:16.925852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:16.927795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:16.930338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:16.932744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 188/372] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:16.933906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:16.938056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:16.957595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d00ec-f2bc-415a-ae88-7bd14b56cf37 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:17.001601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:17.002171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.002456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.002739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.004110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:17.005976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:17.007639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 185/373] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:17.009622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:17.075057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ae8dc-89c1-4454-8205-d688776ee209 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:17.128209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7f1d3-5456-4bdb-9658-de4cd9ab9ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:17.128673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7f1d3-5456-4bdb-9658-de4cd9ab9ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.128844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7f1d3-5456-4bdb-9658-de4cd9ab9ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.130499 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7f1d3-5456-4bdb-9658-de4cd9ab9ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.138187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4c9dcb-5ff9-45d8-b831-1d80e9ddfce9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:17.162975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:17.185646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:17.186544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.186797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.187078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.188963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:17.190430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:17.192603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 186/374] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:17 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:17.193013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:17.224545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7f1d3-5456-4bdb-9658-de4cd9ab9ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:17.226269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7f1d3-5456-4bdb-9658-de4cd9ab9ca3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:17.230205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:17.323212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5d4a3-b509-4471-8b97-afbe7331c1dd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:17.362575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 189/375] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:17.363739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b111-0205-48bf-ad6d-d66483566fd5 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.364024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b111-0205-48bf-ad6d-d66483566fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.364301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7b111-0205-48bf-ad6d-d66483566fd5 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.370266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27e51c-cd8f-4a63-9c3a-d930aca737e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:17.370709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 190/376] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:17.371363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e51c-cd8f-4a63-9c3a-d930aca737e5 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.371538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7b111-0205-48bf-ad6d-d66483566fd5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:17.371993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e51c-cd8f-4a63-9c3a-d930aca737e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.372492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27e51c-cd8f-4a63-9c3a-d930aca737e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.373517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e51c-cd8f-4a63-9c3a-d930aca737e5 None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=164a8167edb3454aac80d6dda070f6b9) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:17.374008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e51c-cd8f-4a63-9c3a-d930aca737e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:17.376809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27e51c-cd8f-4a63-9c3a-d930aca737e5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:17.384042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 187/377] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:17 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:17.386105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e738-df2d-4215-a78c-c6e1f7ad0101 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.386579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e738-df2d-4215-a78c-c6e1f7ad0101 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.387182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e738-df2d-4215-a78c-c6e1f7ad0101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.409165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0ba0e738-df2d-4215-a78c-c6e1f7ad0101 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:17.410363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0ba0e738-df2d-4215-a78c-c6e1f7ad0101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:17.464920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:17.499119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 188/378] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:17.499847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e738-df2d-4215-a78c-c6e1f7ad0101 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:17.545781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7b111-0205-48bf-ad6d-d66483566fd5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:17.549725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:17.586911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:17.587699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.587914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.588188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.589087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=164a8167edb3454aac80d6dda070f6b9) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:17.589417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:17.591174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:17.600938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 191/379] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:17 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:17.605749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:17.635524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e738-df2d-4215-a78c-c6e1f7ad0101 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:17.685544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:17.686787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.688038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.689238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] PATH_INFO: `/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.692201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] RBAC: Authorizing `identity:get_project(project_id=aedab9ecfa9f4a4fb3686cc6fffd6442)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:17.694600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:17.697549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 189/380] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:17 2022] GET /identity/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442 => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:17.703343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:17.782045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ba2d7-70a6-4837-8916-1193c8e88f42 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:17.823363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:17.826338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:17.827447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:17.827940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:17.828451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:17.843515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:17.853132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:17.854066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:17.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:17.857772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 192/381] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:17.866083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:17.904660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:17.954512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411de2c6-d053-4ed9-bf66-1d21c240d486 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.004518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246e325-8d18-47ab-a43a-893fbb85bea7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.005675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.006651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.006942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.007215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] PATH_INFO: `/v3/groups/31136cd394444c7bb2bb1b18a9a65194` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.021489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] RBAC: Authorizing `identity:get_group(group_id=31136cd394444c7bb2bb1b18a9a65194)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:18.022957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:18.025193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 190/382] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:17 2022] GET /identity/v3/groups/31136cd394444c7bb2bb1b18a9a65194 => generated 229 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:18.030927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:18.045807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.047258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.047857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.048532 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.049514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:18.050048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:18.051628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:18.062289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 193/383] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:18.070139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:18.173926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:18.181498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca94e0b1-9d85-49cb-a419-364b00e6d4fb None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.219217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4254c-6a8c-4417-af20-3e0d6ca26410 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.220365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.221284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.221855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.222137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.223415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:18.225861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:18.227840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 194/384] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:18 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:18.236543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:18.241784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:18.287221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4599c0fe-a12e-48ed-9a00-f7c2818e6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.287881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c0fe-a12e-48ed-9a00-f7c2818e6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.288209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c0fe-a12e-48ed-9a00-f7c2818e6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.288514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4599c0fe-a12e-48ed-9a00-f7c2818e6ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.289428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c0fe-a12e-48ed-9a00-f7c2818e6ed2 None admin] RBAC: Adding query filter params (group.id=31136cd394444c7bb2bb1b18a9a65194, role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=aedab9ecfa9f4a4fb3686cc6fffd6442) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:18.289740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c0fe-a12e-48ed-9a00-f7c2818e6ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:18.291187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4599c0fe-a12e-48ed-9a00-f7c2818e6ed2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:18.301503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 191/385] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:18 2022] GET /identity/v3/role_assignments?group.id=31136cd394444c7bb2bb1b18a9a65194&scope.project.id=aedab9ecfa9f4a4fb3686cc6fffd6442&role.id=add60904ef824ad3b92149e0f251f55c => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:18.415484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3ad23-50c0-4b72-8538-59ab3a14336e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.463639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.464864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.465302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.465727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.467236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:18.468925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:18.472012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 195/386] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:18 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:18.476664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62246-9177-4e5e-a77c-b35a1663be82 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.477172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62246-9177-4e5e-a77c-b35a1663be82 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.477600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f62246-9177-4e5e-a77c-b35a1663be82 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.479178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 192/387] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:18.484637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:18.486930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890923-ce9e-4b01-a752-ebacb2f584ef None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.487393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890923-ce9e-4b01-a752-ebacb2f584ef None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.487818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890923-ce9e-4b01-a752-ebacb2f584ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.514964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8c890923-ce9e-4b01-a752-ebacb2f584ef None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:18.517273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8c890923-ce9e-4b01-a752-ebacb2f584ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:18.551678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:18.627000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 193/388] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:18.660999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eca752-0a1b-44b2-8d4c-aed64bc3875f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.677634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c890923-ce9e-4b01-a752-ebacb2f584ef None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:18.716522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.717346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.717636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.717918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5/groups/d895ba148dae48acad6d9e324af4f80f/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.723930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7344bc63d8b4a1589024f667739a6b5, group_id=d895ba148dae48acad6d9e324af4f80f, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:18.727049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:18.811896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 196/389] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 2 13:32:18 2022] PUT /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5/groups/d895ba148dae48acad6d9e324af4f80f/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:18.825234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c890923-ce9e-4b01-a752-ebacb2f584ef None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:18.826973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:18.866049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:18.866934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:18.867225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:18.867506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:18.880128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:18.888746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:18.889694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:18.890515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 194/390] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:18.899074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:19.017441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:19.024784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3f695-400c-4e4c-906b-33565dc86330 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:19.062185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:19.062877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:19.063877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:19.064494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:19.065093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:19.065412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:19.066828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:19.076855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 197/391] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:19.085627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:19.201159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5758355-2d15-43e4-b091-d81cab3f1aae None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:19.239627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cd802-a704-4474-84f6-05572508332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:19.240519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cd802-a704-4474-84f6-05572508332a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:19.240811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cd802-a704-4474-84f6-05572508332a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:19.241091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cd802-a704-4474-84f6-05572508332a None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:19.242276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cd802-a704-4474-84f6-05572508332a None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:19.243744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13cd802-a704-4474-84f6-05572508332a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:19.245775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 195/392] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:19 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:19.251846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:19.356772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003c7cb-a891-41bb-a14b-fa59a759d00e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:19.392723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610d61-8961-443c-810a-b9e85dd7c121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:19.393591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610d61-8961-443c-810a-b9e85dd7c121 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:19.393883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610d61-8961-443c-810a-b9e85dd7c121 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:19.394165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610d61-8961-443c-810a-b9e85dd7c121 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:19.395379 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610d61-8961-443c-810a-b9e85dd7c121 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:19.396861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610d61-8961-443c-810a-b9e85dd7c121 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:19.398939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 198/393] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:19 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:19.406286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cd802-a704-4474-84f6-05572508332a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:19.461224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:19.539996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cd802-a704-4474-84f6-05572508332a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:19.576270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c42fe-5da8-4af2-9042-598fa4b909f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:19.577192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c42fe-5da8-4af2-9042-598fa4b909f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:19.577474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c42fe-5da8-4af2-9042-598fa4b909f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:19.577750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c42fe-5da8-4af2-9042-598fa4b909f5 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5/groups/d895ba148dae48acad6d9e324af4f80f/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:19.580609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c42fe-5da8-4af2-9042-598fa4b909f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7344bc63d8b4a1589024f667739a6b5, group_id=d895ba148dae48acad6d9e324af4f80f, role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:19.582113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c42fe-5da8-4af2-9042-598fa4b909f5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:19.656622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 196/394] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 2 13:32:19 2022] PUT /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5/groups/d895ba148dae48acad6d9e324af4f80f/roles/6fcb971d81654e48875c8cd12e298a9e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:20.251201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158d49-83db-42ae-b52b-13aa3d5da127 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:20.251721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158d49-83db-42ae-b52b-13aa3d5da127 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:20.251993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03158d49-83db-42ae-b52b-13aa3d5da127 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:20.253324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 199/395] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:20.258666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f772-bc0c-443d-a518-38683e87c062 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:20.259082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f772-bc0c-443d-a518-38683e87c062 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:20.259269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38f772-bc0c-443d-a518-38683e87c062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:20.284819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0b38f772-bc0c-443d-a518-38683e87c062 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:20.286051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0b38f772-bc0c-443d-a518-38683e87c062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:20.382079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 197/396] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:20.426483 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158d49-83db-42ae-b52b-13aa3d5da127 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:20.447964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:20.597370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03158d49-83db-42ae-b52b-13aa3d5da127 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:20.656600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:20.657452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:20.657740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:20.658020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:20.666016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1fc28-36ee-4d8e-b3cb-570ce7d68f25 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:20.666306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1fc28-36ee-4d8e-b3cb-570ce7d68f25 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:20.666590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1fc28-36ee-4d8e-b3cb-570ce7d68f25 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:20.667974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 198/397] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:20.684220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:20.694208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076e29-d66c-4705-ac53-18f598833946 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:20.694497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076e29-d66c-4705-ac53-18f598833946 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:20.694776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27076e29-d66c-4705-ac53-18f598833946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:20.700007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:20.700924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:20.701744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:20.712035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 200/398] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:20.713367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:20.729121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-27076e29-d66c-4705-ac53-18f598833946 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:20.730588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-27076e29-d66c-4705-ac53-18f598833946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:20.771220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:20.817338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:20.857894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da3ef8-bcff-47d3-8259-cf0a0ddd5cd2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:20.892073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 199/399] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:20.899845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:20.900547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:20.900837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:20.901118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:20.901863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:20.902172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:20.903543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:20.916512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 201/400] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:20.918401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076e29-d66c-4705-ac53-18f598833946 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:20.928363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.046948 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f4189-5c90-4771-b867-ef772fe7aea3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.084114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.084967 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.085258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.085533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.092317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27076e29-d66c-4705-ac53-18f598833946 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.092841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:21.098505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:21.106766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:21.107689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:21.108612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 202/401] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:21.114250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.166621 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.167508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.167798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.168106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.173397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:21.174905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:21.177046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 200/402] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:20 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:21.191477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.228853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:21.232063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4344f3-b0ed-4be4-8474-f41468f03d2d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.269752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.270540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.270708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.270991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.271793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:21.272103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:21.273523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:21.281997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 203/403] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:21.294216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.348137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe607ec-a13f-433f-94f1-f7d6ea7807b8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.377208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:21.397926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3388e8-aed7-4ec5-8a47-c28f89d5d52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.398839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3388e8-aed7-4ec5-8a47-c28f89d5d52f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.399136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3388e8-aed7-4ec5-8a47-c28f89d5d52f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.399419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3388e8-aed7-4ec5-8a47-c28f89d5d52f None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.401284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3388e8-aed7-4ec5-8a47-c28f89d5d52f None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:21.403464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3388e8-aed7-4ec5-8a47-c28f89d5d52f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:21.410954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 201/404] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:21 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:21.412550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd259f-7935-4aec-b722-11b13122a234 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.412851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd259f-7935-4aec-b722-11b13122a234 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.413133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd259f-7935-4aec-b722-11b13122a234 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.414709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 202/405] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:21.415694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd259f-7935-4aec-b722-11b13122a234 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.440572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7f0e-cf1d-47dd-84d0-4e6d0a17f389 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.475344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89850c91-5feb-4a89-b28e-823f5184f2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.476219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89850c91-5feb-4a89-b28e-823f5184f2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.476545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89850c91-5feb-4a89-b28e-823f5184f2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.476822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89850c91-5feb-4a89-b28e-823f5184f2b0 None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.478008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89850c91-5feb-4a89-b28e-823f5184f2b0 None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:21.479453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89850c91-5feb-4a89-b28e-823f5184f2b0 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:21.487627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 204/406] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:21 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:21.489015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c74507-90de-47d9-aaec-0a5007109b94 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.489305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c74507-90de-47d9-aaec-0a5007109b94 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.489581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c74507-90de-47d9-aaec-0a5007109b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.512561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a8c74507-90de-47d9-aaec-0a5007109b94 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:21.513985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a8c74507-90de-47d9-aaec-0a5007109b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:21.536394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:21.558278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd259f-7935-4aec-b722-11b13122a234 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.588774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 205/407] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:21.590069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c74507-90de-47d9-aaec-0a5007109b94 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.622097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.622888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.623181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.623451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9/groups/d895ba148dae48acad6d9e324af4f80f/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.628237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=164a8167edb3454aac80d6dda070f6b9, group_id=d895ba148dae48acad6d9e324af4f80f, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:21.629707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:21.676458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:21.717791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c74507-90de-47d9-aaec-0a5007109b94 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.743030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 203/408] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 2 13:32:21 2022] PUT /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9/groups/d895ba148dae48acad6d9e324af4f80f/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:32:21.749798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.775736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f189bc9-d699-4dc5-bacb-6468cff81fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.776650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189bc9-d699-4dc5-bacb-6468cff81fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.776937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189bc9-d699-4dc5-bacb-6468cff81fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.777220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189bc9-d699-4dc5-bacb-6468cff81fa2 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.778472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f189bc9-d699-4dc5-bacb-6468cff81fa2 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:21.779969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f189bc9-d699-4dc5-bacb-6468cff81fa2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:21.787095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 206/409] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:21 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:21.788723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661f16-3262-46d0-abef-1dc2adbcd88e None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.789021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661f16-3262-46d0-abef-1dc2adbcd88e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.789301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41661f16-3262-46d0-abef-1dc2adbcd88e None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.790707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 207/410] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:21.791445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661f16-3262-46d0-abef-1dc2adbcd88e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:21.892104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd07a5-fccf-42db-be38-6b1a3fe520b9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.940849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6cbf2-6c1b-4f2c-a2b6-5af5b4fa92bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.941059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41661f16-3262-46d0-abef-1dc2adbcd88e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:21.942133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6cbf2-6c1b-4f2c-a2b6-5af5b4fa92bb None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.942956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6cbf2-6c1b-4f2c-a2b6-5af5b4fa92bb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.943413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6cbf2-6c1b-4f2c-a2b6-5af5b4fa92bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.963757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6cbf2-6c1b-4f2c-a2b6-5af5b4fa92bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:21.970992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-afd6cbf2-6c1b-4f2c-a2b6-5af5b4fa92bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:21.975040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:21.975922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:21.977199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 204/411] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:21.981668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e8ee0-f627-4e67-b5ab-156d6c053591 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.982036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e8ee0-f627-4e67-b5ab-156d6c053591 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.985847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e8ee0-f627-4e67-b5ab-156d6c053591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.986777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:21.987746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:21.988025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:21.988296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9/groups/d895ba148dae48acad6d9e324af4f80f/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:21.990581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] RBAC: Authorizing `identity:create_grant(project_id=164a8167edb3454aac80d6dda070f6b9, group_id=d895ba148dae48acad6d9e324af4f80f, role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:21.992013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:21.996320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:22.003244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-1b6e8ee0-f627-4e67-b5ab-156d6c053591 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:22.004507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1b6e8ee0-f627-4e67-b5ab-156d6c053591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:22.076565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 205/412] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:22.077895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e8ee0-f627-4e67-b5ab-156d6c053591 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.082252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 208/413] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 2 13:32:21 2022] PUT /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9/groups/d895ba148dae48acad6d9e324af4f80f/roles/6fcb971d81654e48875c8cd12e298a9e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:22.129758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.202111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e8ee0-f627-4e67-b5ab-156d6c053591 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.242443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.243129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.243416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.243691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.244475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:22.244788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:22.246210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:22.248932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:22.256180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 206/414] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:22.262083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.334467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af33ab-a9db-4a05-bd98-b65b27b6e819 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.377502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf5b4e-e1f1-491b-b85a-47f9a19cba99 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.418118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.418966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.419252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.419373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.419581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.420222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.420586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.420880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] PATH_INFO: `/v3/groups/31136cd394444c7bb2bb1b18a9a65194` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.422831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] RBAC: Authorizing `identity:get_group(group_id=31136cd394444c7bb2bb1b18a9a65194)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:22.424482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:22.426514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 207/415] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/groups/31136cd394444c7bb2bb1b18a9a65194 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:22.431707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.435814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:22.443828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:22.444779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:22.445588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 209/416] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:22.452565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.511177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:22.520976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:22.560497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be724a7-42f3-4fcd-ab72-d88fed36b7b5 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.580718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2089e8-ac37-4f61-92a4-1f527c7f2448 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.600966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2959f7b1-e675-49f0-b402-7a5d2eb3c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.601724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f7b1-e675-49f0-b402-7a5d2eb3c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.602012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f7b1-e675-49f0-b402-7a5d2eb3c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.602290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2959f7b1-e675-49f0-b402-7a5d2eb3c0b8 None admin] PATH_INFO: `/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.603493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959f7b1-e675-49f0-b402-7a5d2eb3c0b8 None admin] RBAC: Authorizing `identity:get_project(project_id=aedab9ecfa9f4a4fb3686cc6fffd6442)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:22.605482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2959f7b1-e675-49f0-b402-7a5d2eb3c0b8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:22.607036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 208/417] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:22.612685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7919-5555-4348-b98e-3bf2c3579d0c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.612999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7919-5555-4348-b98e-3bf2c3579d0c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.613280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e7919-5555-4348-b98e-3bf2c3579d0c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.615076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 209/418] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:22.619539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7919-5555-4348-b98e-3bf2c3579d0c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.627694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524e651-bf6d-4735-94be-1ed53f22bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.628766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524e651-bf6d-4735-94be-1ed53f22bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.629241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524e651-bf6d-4735-94be-1ed53f22bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.629699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524e651-bf6d-4735-94be-1ed53f22bba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.630631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524e651-bf6d-4735-94be-1ed53f22bba5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:22.631117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524e651-bf6d-4735-94be-1ed53f22bba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:22.632714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524e651-bf6d-4735-94be-1ed53f22bba5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:22.642611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 210/419] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:22.648561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01099fc-1aca-479c-a18d-0090578bdda4 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.649064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01099fc-1aca-479c-a18d-0090578bdda4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.649533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01099fc-1aca-479c-a18d-0090578bdda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.669628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a01099fc-1aca-479c-a18d-0090578bdda4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:22.671176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a01099fc-1aca-479c-a18d-0090578bdda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:22.729127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e7919-5555-4348-b98e-3bf2c3579d0c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.741469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 211/420] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:22.742555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01099fc-1aca-479c-a18d-0090578bdda4 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.766070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.767461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.767745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.768020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] PATH_INFO: `/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442/groups/31136cd394444c7bb2bb1b18a9a65194/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:22.770460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=aedab9ecfa9f4a4fb3686cc6fffd6442, group_id=31136cd394444c7bb2bb1b18a9a65194, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:22.772057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:22.774417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:22.793512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:22.842100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 210/421] 10.222.0.33 () {58 vars in 1442 bytes} [Thu Jun 2 13:32:22 2022] PUT /identity/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442/groups/31136cd394444c7bb2bb1b18a9a65194/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:32:22.842998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:22.858416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01099fc-1aca-479c-a18d-0090578bdda4 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:22.901420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:22.902437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:22.902925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:22.903401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:23.025444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:23.027322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:23.042820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13db136f-f591-4924-a299-e05822aad5e5 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:23.089435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:23.090267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:23.090549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:23.091173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:23.104776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:23.107391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:23.118123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:23.119060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:23.119873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 211/422] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:23.127095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:23.184317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 212/423] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:23.190946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:23.207010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:23.284757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d79ef-f537-42c1-856c-99c57f56c236 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:23.357914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:23.358590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:23.358873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:23.359144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:23.360022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:23.360352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:23.361761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:23.379941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 212/424] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:23.382026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e04cea4-1959-4d47-949c-8f1833adef6b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:23.386189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:23.453080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:23.454845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:23.455033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:23.455274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:23.456518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:23.457957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:23.459814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 213/425] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:23 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:23.468491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:23.496754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:23.598340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bce04-aaeb-4b4a-b65c-8b6f2877697a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:23.620831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012c35b-2655-43cb-8a4f-4a075ac62a07 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:23.628755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:23.660056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:23.660740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:23.661023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:23.661300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:23.685778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:23.686640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:23.686921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:23.687194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:23.689327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:23.690786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:23.694251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 214/426] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:23 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:23.698863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:23.754340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:23.755817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:23.838147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:23.885537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f319678-c3df-4463-9e9a-04318f17e91b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:23.958779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 213/427] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:23.960914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:23.966188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:23.966842 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:23.967123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:23.967399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:23.968223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=a7344bc63d8b4a1589024f667739a6b5) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:23.968564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:23.970642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:23.994961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 215/428] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:23 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 611 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:23.998556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:24.114633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622fef10-9108-4659-817d-21759fcdb1f4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:24.156368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddead54-0e4b-4a09-ae28-6ae7ff32aca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:24.157965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddead54-0e4b-4a09-ae28-6ae7ff32aca8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.158257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddead54-0e4b-4a09-ae28-6ae7ff32aca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.158533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddead54-0e4b-4a09-ae28-6ae7ff32aca8 None admin] PATH_INFO: `/v3/projects/a7344bc63d8b4a1589024f667739a6b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.165480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddead54-0e4b-4a09-ae28-6ae7ff32aca8 None admin] RBAC: Authorizing `identity:get_project(project_id=a7344bc63d8b4a1589024f667739a6b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:24.167049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddead54-0e4b-4a09-ae28-6ae7ff32aca8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:24.169192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 214/429] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:23 2022] GET /identity/v3/projects/a7344bc63d8b4a1589024f667739a6b5 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:24.175265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:24.308125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41869777-7386-4f9c-a370-01f57268743a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.308428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41869777-7386-4f9c-a370-01f57268743a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.308741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41869777-7386-4f9c-a370-01f57268743a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.311882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 215/430] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:24.321873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee5a70-c831-4df1-89b0-b45e65a22255 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.322166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee5a70-c831-4df1-89b0-b45e65a22255 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.322445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee5a70-c831-4df1-89b0-b45e65a22255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.333351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea6c05-061a-4bda-8a62-beb83b149f71 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:24.345293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8eee5a70-c831-4df1-89b0-b45e65a22255 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:24.346523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8eee5a70-c831-4df1-89b0-b45e65a22255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:24.381174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:24.382058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.382598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.382598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.383809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:24.385316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:24.388463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 216/431] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:24 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:24.393093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:24.412847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:24.445785 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 216/432] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:24.475551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee5a70-c831-4df1-89b0-b45e65a22255 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:24.506870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:24.539378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e7aaf-8a2c-4c74-8ee4-31f04ff39a58 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:24.585008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:24.586561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.586951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.587330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.588285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=a7344bc63d8b4a1589024f667739a6b5) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:24.588715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:24.590242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:24.599415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 217/433] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:24 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=a7344bc63d8b4a1589024f667739a6b5&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 611 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:24.630407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee5a70-c831-4df1-89b0-b45e65a22255 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:24.671620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c34d4-daad-4ee0-9d2d-21169b6e1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:24.673361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c34d4-daad-4ee0-9d2d-21169b6e1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.673856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c34d4-daad-4ee0-9d2d-21169b6e1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.674313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c34d4-daad-4ee0-9d2d-21169b6e1ea4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.690661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c34d4-daad-4ee0-9d2d-21169b6e1ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-720c34d4-daad-4ee0-9d2d-21169b6e1ea4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:24.699188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:24.700151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 02 13:32:24.701025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:24.704122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 217/434] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:24.709816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:24.801935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:24.836076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc5540-4b4b-44ae-94c2-cfd10e64a079 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:24.873748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:24.874354 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.874643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.874922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.876297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:24.876641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:24.878027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:24.887302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 218/435] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:32:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:24.891181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a386-2d49-4eb8-be47-1cdb34bcb20c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.891587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a386-2d49-4eb8-be47-1cdb34bcb20c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.892012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8a386-2d49-4eb8-be47-1cdb34bcb20c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.893629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:24.893946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 218/436] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:24.899276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015ffc-983b-4563-93de-640083c2d03d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:24.899577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015ffc-983b-4563-93de-640083c2d03d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:24.899938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f015ffc-983b-4563-93de-640083c2d03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:24.922920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5f015ffc-983b-4563-93de-640083c2d03d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:24.928637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5f015ffc-983b-4563-93de-640083c2d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:25.030963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a963e52-7fe4-484f-b0af-17a616fd3b0b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.031387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 219/437] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:25.055392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015ffc-983b-4563-93de-640083c2d03d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.058456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.066625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.072272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.073222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.077214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.077214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.171154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:25.173669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:25.207021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f015ffc-983b-4563-93de-640083c2d03d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.245049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.245853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.246137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.246416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.256989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:25.265079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:25.266567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:25.267520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 220/438] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:25.272685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.304529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 219/439] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:32:25.305629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.336644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.350237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.390032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a0310-035d-4e26-b95e-2eda02f075de None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.412142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491b8ba-56c5-4869-9a25-50f0715bd9ca None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.431633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.432240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.432567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.432851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.433626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:25.433942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:25.435372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:25.445307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 221/440] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:25.450781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.564226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24cbaf-e196-4e89-82b0-82723c2940ce None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.569887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001acd6b-4a04-4ad4-a6a3-e24b811890c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.570735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001acd6b-4a04-4ad4-a6a3-e24b811890c6 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.571023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001acd6b-4a04-4ad4-a6a3-e24b811890c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.571299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001acd6b-4a04-4ad4-a6a3-e24b811890c6 None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.572488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001acd6b-4a04-4ad4-a6a3-e24b811890c6 None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:25.573899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001acd6b-4a04-4ad4-a6a3-e24b811890c6 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:25.575600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 220/441] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:25.576769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0f28-7796-489b-abbc-41103a54ecd1 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.577049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0f28-7796-489b-abbc-41103a54ecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.577321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe0f28-7796-489b-abbc-41103a54ecd1 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.580299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 221/442] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:25.583901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe0f28-7796-489b-abbc-41103a54ecd1 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.593130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.601538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.602184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.602467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.606971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.669688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:25.671153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:25.688946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.692504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe0f28-7796-489b-abbc-41103a54ecd1 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.726204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36940ebe-44f3-4142-9280-7e2a559762d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.727043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36940ebe-44f3-4142-9280-7e2a559762d9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.727324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36940ebe-44f3-4142-9280-7e2a559762d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.727594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36940ebe-44f3-4142-9280-7e2a559762d9 None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.728770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36940ebe-44f3-4142-9280-7e2a559762d9 None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:25.730436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36940ebe-44f3-4142-9280-7e2a559762d9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:25.732027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 222/443] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:25.733158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc8f1-53ef-47a1-9738-9a82e6289c25 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.733442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc8f1-53ef-47a1-9738-9a82e6289c25 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.733715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fc8f1-53ef-47a1-9738-9a82e6289c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.754502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1e2fc8f1-53ef-47a1-9738-9a82e6289c25 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:25.755683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1e2fc8f1-53ef-47a1-9738-9a82e6289c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:25.773264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 222/444] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 02 13:32:25.777951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.808015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.846027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 223/445] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:25.846877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc8f1-53ef-47a1-9738-9a82e6289c25 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.883096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d95e4-96eb-4012-9090-d0ea9968d2b3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:25.916585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733438-2dda-4691-997d-113de49136c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:25.917233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733438-2dda-4691-997d-113de49136c6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:25.917516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733438-2dda-4691-997d-113de49136c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:25.917797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72733438-2dda-4691-997d-113de49136c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:25.918616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72733438-2dda-4691-997d-113de49136c6 None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=2dc928944ffa4e8fb7fe21c9dad9fe57, scope.project.id=164a8167edb3454aac80d6dda070f6b9) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:25.918931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72733438-2dda-4691-997d-113de49136c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:25.920386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72733438-2dda-4691-997d-113de49136c6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:25.927218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 223/446] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:25.927828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733438-2dda-4691-997d-113de49136c6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:25.958539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:25.962958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fc8f1-53ef-47a1-9738-9a82e6289c25 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.003502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.004385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.004705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.004990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] PATH_INFO: `/v3/projects/164a8167edb3454aac80d6dda070f6b9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.006227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] RBAC: Authorizing `identity:get_project(project_id=164a8167edb3454aac80d6dda070f6b9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:26.007696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:26.009481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 224/447] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/projects/164a8167edb3454aac80d6dda070f6b9 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:26.015140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:26.053886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:26.068769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72733438-2dda-4691-997d-113de49136c6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.116467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.117658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.117965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.118555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.131072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:26.138531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:26.139434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:26.140242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 224/448] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:26.146871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:26.147762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b4523-8da8-4e35-a83d-2024698900ce None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.187234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.188173 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.188656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.188950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] PATH_INFO: `/v3/groups/d895ba148dae48acad6d9e324af4f80f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.190178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] RBAC: Authorizing `identity:get_group(group_id=d895ba148dae48acad6d9e324af4f80f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:26.191622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:26.199011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 225/449] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:26 2022] GET /identity/v3/groups/d895ba148dae48acad6d9e324af4f80f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:26.200177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:26.243894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:26.269097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b7692-db45-4b70-ba09-3a23977d4d02 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.312258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.313226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.313606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.313891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.314675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:26.314983 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:26.316373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:26.325560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 225/450] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:26.329885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9c15f-911c-4a0d-ace0-9cd49369d41f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.331300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:26.348068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:26.366854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.367513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.367803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.368090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.368959 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] RBAC: Adding query filter params (group.id=d895ba148dae48acad6d9e324af4f80f, role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=164a8167edb3454aac80d6dda070f6b9) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:26.369275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:26.370818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:26.377112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 226/451] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:26 2022] GET /identity/v3/role_assignments?group.id=d895ba148dae48acad6d9e324af4f80f&scope.project.id=164a8167edb3454aac80d6dda070f6b9&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:26.449067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545e24cb-5c65-4b96-b166-ed28321ef519 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.488779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.489459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.489742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.490027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.561466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:26.563537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:26.578430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:26.664964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 226/452] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:26.670804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:26.779304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:26.783192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f203961-76da-4f54-ac88-31c07bcd9b2b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.815874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.816751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.836806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.836806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] PATH_INFO: `/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.836806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] RBAC: Authorizing `identity:get_project(project_id=aedab9ecfa9f4a4fb3686cc6fffd6442)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:26.836806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:26.836806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 227/453] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:32:26 2022] GET /identity/v3/projects/aedab9ecfa9f4a4fb3686cc6fffd6442 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:26.837201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:26.925063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93ca07e-15c3-4cd9-ab58-27943f98a45e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:26.937581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:26.958030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dfe2e-9d38-4d78-98b2-12fa37a698c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:26.958863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dfe2e-9d38-4d78-98b2-12fa37a698c0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:26.959169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dfe2e-9d38-4d78-98b2-12fa37a698c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:26.959431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dfe2e-9d38-4d78-98b2-12fa37a698c0 None admin] PATH_INFO: `/v3/groups/31136cd394444c7bb2bb1b18a9a65194` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:26.960616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dfe2e-9d38-4d78-98b2-12fa37a698c0 None admin] RBAC: Authorizing `identity:get_group(group_id=31136cd394444c7bb2bb1b18a9a65194)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:26.962079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dfe2e-9d38-4d78-98b2-12fa37a698c0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:26.963680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 227/454] 10.222.0.33 () {56 vars in 1180 bytes} [Thu Jun 2 13:32:26 2022] GET /identity/v3/groups/31136cd394444c7bb2bb1b18a9a65194 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:26.970417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:27.068467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef697cc0-21fc-4a61-a1c1-d01d67c0b39d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:27.100574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c26cc0-cac3-4f4d-9eee-7d85a7b2b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:27.101212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26cc0-cac3-4f4d-9eee-7d85a7b2b041 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:27.101499 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26cc0-cac3-4f4d-9eee-7d85a7b2b041 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:27.101782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c26cc0-cac3-4f4d-9eee-7d85a7b2b041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:27.102611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c26cc0-cac3-4f4d-9eee-7d85a7b2b041 None admin] RBAC: Adding query filter params (group.id=31136cd394444c7bb2bb1b18a9a65194, role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=aedab9ecfa9f4a4fb3686cc6fffd6442) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:27.102932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c26cc0-cac3-4f4d-9eee-7d85a7b2b041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:27.104352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c26cc0-cac3-4f4d-9eee-7d85a7b2b041 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:27.110313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 228/455] 10.222.0.33 () {56 vars in 1376 bytes} [Thu Jun 2 13:32:26 2022] GET /identity/v3/role_assignments?group.id=31136cd394444c7bb2bb1b18a9a65194&scope.project.id=aedab9ecfa9f4a4fb3686cc6fffd6442&role.id=add60904ef824ad3b92149e0f251f55c => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:29.950868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1115d9f-b788-4c69-acd6-df90f179b800 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:29.951887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1115d9f-b788-4c69-acd6-df90f179b800 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:29.952427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1115d9f-b788-4c69-acd6-df90f179b800 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:29.954848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 228/456] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:29.960110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187a62-fd0d-4f6a-b736-772f5fa6153b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:29.960545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187a62-fd0d-4f6a-b736-772f5fa6153b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:29.960716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187a62-fd0d-4f6a-b736-772f5fa6153b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:29.983127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-63187a62-fd0d-4f6a-b736-772f5fa6153b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:29.983340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c587e-2237-42b7-9fe9-915748d0740d None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:29.983550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c587e-2237-42b7-9fe9-915748d0740d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:29.983807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c587e-2237-42b7-9fe9-915748d0740d None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:29.984316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-63187a62-fd0d-4f6a-b736-772f5fa6153b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:29.986188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 229/457] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:29.991430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340735f-5a0b-483d-9a49-9a628022751c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:29.991973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340735f-5a0b-483d-9a49-9a628022751c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:29.992496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340735f-5a0b-483d-9a49-9a628022751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.013471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7340735f-5a0b-483d-9a49-9a628022751c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:30.014981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7340735f-5a0b-483d-9a49-9a628022751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:30.025627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:30.102454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 229/458] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:30.124239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 230/459] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:30.128914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187a62-fd0d-4f6a-b736-772f5fa6153b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.169653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340735f-5a0b-483d-9a49-9a628022751c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.258694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187a62-fd0d-4f6a-b736-772f5fa6153b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:30.301601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9c77a-af4c-4e9e-81fe-ef63abcea8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:30.302401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9c77a-af4c-4e9e-81fe-ef63abcea8aa None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.302686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9c77a-af4c-4e9e-81fe-ef63abcea8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.302963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9c77a-af4c-4e9e-81fe-ef63abcea8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.315077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9c77a-af4c-4e9e-81fe-ef63abcea8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:30.316713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9c77a-af4c-4e9e-81fe-ef63abcea8aa None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-49d9c77a-af4c-4e9e-81fe-ef63abcea8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:30.339518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:30.340472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:30.341336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:30.341336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:30.341336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:30.341336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:30.341336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 230/460] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:30.344426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340735f-5a0b-483d-9a49-9a628022751c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:30.344552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76b31-0ed6-4bbc-88a8-0274f41f952f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.344552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76b31-0ed6-4bbc-88a8-0274f41f952f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.344552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc76b31-0ed6-4bbc-88a8-0274f41f952f None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.344766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 231/461] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:30.353140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287e5c-d045-454c-9401-5591aa0ef04d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.353433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287e5c-d045-454c-9401-5591aa0ef04d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.353883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:30.354647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83287e5c-d045-454c-9401-5591aa0ef04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.372801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-83287e5c-d045-454c-9401-5591aa0ef04d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:30.374008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-83287e5c-d045-454c-9401-5591aa0ef04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:30.378465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:30.379257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.379538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.379839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.382059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:30.390421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:30.392763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:30.412887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:30.414988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:30.417303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:30.417303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:30.417303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:30.417303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:30.417303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 231/462] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:30.417303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.450025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 232/463] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:30.450908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287e5c-d045-454c-9401-5591aa0ef04d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.570644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad845bc3-7135-40f4-9468-33e582290e30 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:30.575347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83287e5c-d045-454c-9401-5591aa0ef04d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:30.605900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:30.606564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.606849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.607127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.607853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:30.608162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:30.610742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:30.620214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608f995-91a0-49c3-b8e1-8cdc89127049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:30.620919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f995-91a0-49c3-b8e1-8cdc89127049 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.621208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f995-91a0-49c3-b8e1-8cdc89127049 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.621491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608f995-91a0-49c3-b8e1-8cdc89127049 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.622221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608f995-91a0-49c3-b8e1-8cdc89127049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:30.623137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608f995-91a0-49c3-b8e1-8cdc89127049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:30.624545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608f995-91a0-49c3-b8e1-8cdc89127049 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:30.630541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 232/464] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:30.635458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.637736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 233/465] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:30.640238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7c0e-4926-4ce0-8494-a9f369ce1e09 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.640561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7c0e-4926-4ce0-8494-a9f369ce1e09 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.641548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad7c0e-4926-4ce0-8494-a9f369ce1e09 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.642874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 234/466] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:30.643635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7c0e-4926-4ce0-8494-a9f369ce1e09 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.647039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:30.663715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:30.742032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775657fc-f3d0-4743-962e-1f8d3fdbd658 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:30.769790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad7c0e-4926-4ce0-8494-a9f369ce1e09 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:30.777540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:30.778339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.778627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.778911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.790225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:30.791709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:30.807901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba73cb-91b0-4dfc-ad40-b7c463af261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:30.808941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba73cb-91b0-4dfc-ad40-b7c463af261c None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.809411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba73cb-91b0-4dfc-ad40-b7c463af261c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.809872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba73cb-91b0-4dfc-ad40-b7c463af261c None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.810760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba73cb-91b0-4dfc-ad40-b7c463af261c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:30.812383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba73cb-91b0-4dfc-ad40-b7c463af261c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:30.813051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:30.813924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:30.814772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:30.814772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:30.814772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:30.814772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:30.814772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 233/467] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:30.815032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:30.897903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 235/468] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:32:30 2022] POST /identity/v3/users => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:30.899750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ed14-6e6a-4c29-b6da-24b368c87c53 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:30.900241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ed14-6e6a-4c29-b6da-24b368c87c53 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:30.900757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ed14-6e6a-4c29-b6da-24b368c87c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:30.928226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-2645ed14-6e6a-4c29-b6da-24b368c87c53 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:30.930070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2645ed14-6e6a-4c29-b6da-24b368c87c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:31.021294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:31.024833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 236/469] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:31.029047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ed14-6e6a-4c29-b6da-24b368c87c53 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:31.029407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:31.059789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed895a-d0cf-4701-9a48-d22a0d55a4a8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.101032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.101734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.102025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.102305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.103364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.104613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.157594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ed14-6e6a-4c29-b6da-24b368c87c53 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.196321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.197015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.197308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.197588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.198374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:31.198688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.200069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.212982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 237/470] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:31.214271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:31.220222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 234/471] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:32:30 2022] POST /identity/v3/users => generated 248 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:31.230564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:31.273157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:31.340530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb6739-037e-4d43-8e54-a0498c1ee183 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.382269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.383332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.383788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.384688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.399447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.401217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:31.421976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:31.423387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:31.424233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:31.424233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:31.424233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:31.424233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:31.426962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 238/472] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:31.432902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:31.445896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd251149-6e99-42d3-8457-96cb49a2efb9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.481646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:31.489341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8e394-0cab-49f2-b995-125a0678779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.491871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e394-0cab-49f2-b995-125a0678779f None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.491871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e394-0cab-49f2-b995-125a0678779f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.491871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8e394-0cab-49f2-b995-125a0678779f None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.491871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8e394-0cab-49f2-b995-125a0678779f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.492797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8e394-0cab-49f2-b995-125a0678779f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.561999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:31.566009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d048a-71bb-4a75-bd6c-5407adcf9f8a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.576617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 235/473] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:32:31 2022] POST /identity/v3/users => generated 248 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:32:31.578551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed461-6e72-419c-b341-ebe0932222ac None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.578551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed461-6e72-419c-b341-ebe0932222ac None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.578551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bed461-6e72-419c-b341-ebe0932222ac None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.580019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 236/474] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:31.585492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99833029-e323-4f6a-85c2-7a5706e08cac None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.585859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99833029-e323-4f6a-85c2-7a5706e08cac None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.586139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99833029-e323-4f6a-85c2-7a5706e08cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.607063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-99833029-e323-4f6a-85c2-7a5706e08cac None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:31.608349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-99833029-e323-4f6a-85c2-7a5706e08cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:31.635183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.636804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.637085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.637363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.638393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:31.640256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.642992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.660945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 239/475] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:31.666769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:31.778990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 237/476] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:31.792233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8c95d9-72a6-4eeb-bfd8-44fe88933610 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.810872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99833029-e323-4f6a-85c2-7a5706e08cac None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:31.845486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.846673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.847166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.847656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.848555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.850954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:31.940702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99833029-e323-4f6a-85c2-7a5706e08cac None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:31.946519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 240/477] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:32:31 2022] POST /identity/v3/users => generated 249 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:31.961262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:31.982641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:31.983333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:31.983620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:31.983907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:31.985287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:31.986788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:32.062762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.sql.core [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:32:32.062762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:32:32.062762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [parameters: {'id': 'e207b2371eec4352af0315f541079248', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:32:32.062762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80598) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application result.read() Jun 02 13:32:32.081618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return ref.to_dict() Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:32:32.082551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application yield resource Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise self.value Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application session.commit() Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:32:32.083537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:32:32.084439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:32:32.089472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application result.read() Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:32:32.091564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [parameters: {'id': 'e207b2371eec4352af0315f541079248', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:32.093582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 02 13:32:32.095736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:32.097770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 238/478] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 2 13:32:31 2022] POST /identity/v3/roles => generated 144 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:32.097918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:32.124017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:32.226160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08989b89-b62e-4c28-b701-c89ce5a6720f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:32.266136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b080873-adeb-46fb-8ba6-77d9911c022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:32.267087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080873-adeb-46fb-8ba6-77d9911c022d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:32.267392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080873-adeb-46fb-8ba6-77d9911c022d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:32.267666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b080873-adeb-46fb-8ba6-77d9911c022d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:32.279357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b080873-adeb-46fb-8ba6-77d9911c022d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-6b080873-adeb-46fb-8ba6-77d9911c022d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:32.288497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:32.290677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:32.292681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 241/479] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:32:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:32.300448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:32.408083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16feec-e573-40aa-906e-f98728b20edb None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:32.446443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd94043-fe3f-4180-86c5-fd35581d484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:32.447124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94043-fe3f-4180-86c5-fd35581d484b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:32.447412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94043-fe3f-4180-86c5-fd35581d484b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:32.447694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd94043-fe3f-4180-86c5-fd35581d484b None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:32.448497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94043-fe3f-4180-86c5-fd35581d484b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:32.448818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94043-fe3f-4180-86c5-fd35581d484b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:32.450295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd94043-fe3f-4180-86c5-fd35581d484b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:32.459733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 239/480] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:33.877822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db624-28eb-4341-99d6-7062e9bff48a None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:33.878563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db624-28eb-4341-99d6-7062e9bff48a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:33.878563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807db624-28eb-4341-99d6-7062e9bff48a None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:33.881020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 242/481] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:33.887399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d5eb2-3218-40bf-8dc2-e459b94ccaea None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:33.887847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d5eb2-3218-40bf-8dc2-e459b94ccaea None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:33.888041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d5eb2-3218-40bf-8dc2-e459b94ccaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:33.905507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3c2d5eb2-3218-40bf-8dc2-e459b94ccaea None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:33.907303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3c2d5eb2-3218-40bf-8dc2-e459b94ccaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:33.953541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:34.002821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 240/482] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:34.047610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db624-28eb-4341-99d6-7062e9bff48a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44777a-2b93-4dc9-b7a5-b81e3c5cd611 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.112296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44777a-2b93-4dc9-b7a5-b81e3c5cd611 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.112536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44777a-2b93-4dc9-b7a5-b81e3c5cd611 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.113931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 241/483] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:34.120456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb8e6-26c9-4176-8777-22002b54d935 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.120745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb8e6-26c9-4176-8777-22002b54d935 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.121038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedb8e6-26c9-4176-8777-22002b54d935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.143683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-1eedb8e6-26c9-4176-8777-22002b54d935 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:34.145894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1eedb8e6-26c9-4176-8777-22002b54d935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:34.164802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:34.216846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807db624-28eb-4341-99d6-7062e9bff48a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:34.247150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 242/484] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:34.274237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb8e6-26c9-4176-8777-22002b54d935 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.285866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:34.286679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.286970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.287245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.299798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:34.307651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:34.308560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:34.309356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 243/485] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:34.315006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.391184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedb8e6-26c9-4176-8777-22002b54d935 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:34.408829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:34.433635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:34.435494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.436255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.437364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.452707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:34.462205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:34.463172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:34.464015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:34.467389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 243/486] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:34.473358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.568845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3a230-71a6-466f-8351-ebc2096b60a7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:34.593343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9d5adc-e637-4c95-b83e-d4de252d9230 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:34.604270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b96f04-d3c5-410c-9833-805df9ad76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:34.605277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b96f04-d3c5-410c-9833-805df9ad76c1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.605766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b96f04-d3c5-410c-9833-805df9ad76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.605879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b96f04-d3c5-410c-9833-805df9ad76c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.606560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b96f04-d3c5-410c-9833-805df9ad76c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:34.606872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b96f04-d3c5-410c-9833-805df9ad76c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:34.608248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b96f04-d3c5-410c-9833-805df9ad76c1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:34.611214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:34.618390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 244/487] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:34.624348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86156-5155-4e23-8284-b7cfb5dbe365 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.624348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86156-5155-4e23-8284-b7cfb5dbe365 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.624348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe86156-5155-4e23-8284-b7cfb5dbe365 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.630659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 245/488] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:34.630659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86156-5155-4e23-8284-b7cfb5dbe365 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.640329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb3677-0876-4cb7-83d0-9280693d79f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:34.641405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3677-0876-4cb7-83d0-9280693d79f5 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.641900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3677-0876-4cb7-83d0-9280693d79f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.642394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb3677-0876-4cb7-83d0-9280693d79f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.644276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb3677-0876-4cb7-83d0-9280693d79f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:34.645085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb3677-0876-4cb7-83d0-9280693d79f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:34.646801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb3677-0876-4cb7-83d0-9280693d79f5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:34.656050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 244/489] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:34.662481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12aecf-ff71-411f-accc-98b628a4247b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.663001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12aecf-ff71-411f-accc-98b628a4247b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.663489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12aecf-ff71-411f-accc-98b628a4247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.680838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ec12aecf-ff71-411f-accc-98b628a4247b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:34.682387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ec12aecf-ff71-411f-accc-98b628a4247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:34.701991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:34.742910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe86156-5155-4e23-8284-b7cfb5dbe365 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:34.760025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 245/490] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:34.769534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12aecf-ff71-411f-accc-98b628a4247b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.779162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:34.779969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.780262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.780600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.791988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:34.793838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:34.815216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:34.816125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:34.817034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:34.817034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:34.817034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:34.817034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:34.817034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 246/491] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:34.820755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.880795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:34.896943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12aecf-ff71-411f-accc-98b628a4247b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:34.928944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc98a8-de13-4a4b-a912-08ac62628675 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:34.934585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:34.935667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.936151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.936655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.948009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:34.949936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:34.968417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:34.969312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:34.969783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:34.970066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:34.972549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:34.973430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:34.974298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:34.974298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:34.974298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:34.974298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:34.981321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 246/492] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:34.982623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:34.987437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:34.992981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:34.996472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:34.997554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:34.998577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:35.000944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 247/493] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:35.011010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.109597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6215c-5ac8-4293-ac69-ab6dc8d6b1ca None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.123992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bdc1f-b005-480e-9002-234dd4822dca None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.135336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.144687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.147606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.147606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.147606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.147606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:35.147606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.148521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.165907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709d6bb-6001-46d4-a987-820276326d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.166125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 247/494] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:35.166207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d6bb-6001-46d4-a987-820276326d30 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.166279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.166348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d6bb-6001-46d4-a987-820276326d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.166348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d6bb-6001-46d4-a987-820276326d30 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.166348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709d6bb-6001-46d4-a987-820276326d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:35.166348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709d6bb-6001-46d4-a987-820276326d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.166348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f709d6bb-6001-46d4-a987-820276326d30 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.183811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 248/495] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:35.183811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cabce-4193-49a3-8dd2-71c084e8214f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.183811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cabce-4193-49a3-8dd2-71c084e8214f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.183811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cabce-4193-49a3-8dd2-71c084e8214f None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.183811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 249/496] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:35.183811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cabce-4193-49a3-8dd2-71c084e8214f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.243184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.278695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5472bf8-89ea-4b63-88e6-fd21dccd9df2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.293526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17cabce-4193-49a3-8dd2-71c084e8214f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.316341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.317057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.317341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.317620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.318372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:35.318686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.320090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.328705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45e675-cf56-437a-ab3c-d3c6b0e9745c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.329486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e675-cf56-437a-ab3c-d3c6b0e9745c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.329767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e675-cf56-437a-ab3c-d3c6b0e9745c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.330041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45e675-cf56-437a-ab3c-d3c6b0e9745c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.333410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 248/497] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:35.334067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.337246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45e675-cf56-437a-ab3c-d3c6b0e9745c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.338673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45e675-cf56-437a-ab3c-d3c6b0e9745c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-0b45e675-cf56-437a-ab3c-d3c6b0e9745c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:35.354513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:35.355789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:35.356940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 250/498] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:35.357545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02c36-7fe2-4fda-b0e0-491494c93900 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.357545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02c36-7fe2-4fda-b0e0-491494c93900 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.357675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d02c36-7fe2-4fda-b0e0-491494c93900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.374917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-77d02c36-7fe2-4fda-b0e0-491494c93900 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:35.376207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-77d02c36-7fe2-4fda-b0e0-491494c93900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:35.399688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.438004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2165c5-d361-4107-8efb-a189359d163c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.443419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 251/499] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:35.444758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df716f-0715-4fe7-8151-b988f4b08988 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.445055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df716f-0715-4fe7-8151-b988f4b08988 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.445332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df716f-0715-4fe7-8151-b988f4b08988 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.448775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 252/500] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:35.448775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df716f-0715-4fe7-8151-b988f4b08988 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.466486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.474510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.475309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.475598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.479655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.483817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.485458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:35.503540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:35.504656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 249/501] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:35.506331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.553042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df716f-0715-4fe7-8151-b988f4b08988 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.588682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67191068-fc4a-4ad5-aba2-d60b41fd8046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.589463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191068-fc4a-4ad5-aba2-d60b41fd8046 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.589744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191068-fc4a-4ad5-aba2-d60b41fd8046 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.590020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67191068-fc4a-4ad5-aba2-d60b41fd8046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.600392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67191068-fc4a-4ad5-aba2-d60b41fd8046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.601848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67191068-fc4a-4ad5-aba2-d60b41fd8046 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.609155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508f22-20b3-4f80-a931-82f2fb50cbf4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-67191068-fc4a-4ad5-aba2-d60b41fd8046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:35.620963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:35.621857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:35.622711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:35.622711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:35.622711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:35.622711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:35.622711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 253/502] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:35.623394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a212c-4754-419b-845d-541b50fd5a96 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.623659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a212c-4754-419b-845d-541b50fd5a96 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.624015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a212c-4754-419b-845d-541b50fd5a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.642971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0e9a212c-4754-419b-845d-541b50fd5a96 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:35.644380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0e9a212c-4754-419b-845d-541b50fd5a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:35.648541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.649210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.649496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.649774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.650607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:35.650919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.651793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.652361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.690367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 250/503] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:35.691110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.712053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 254/504] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:35.712854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a212c-4754-419b-845d-541b50fd5a96 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.747890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.800626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1743a7f-ee96-4c66-894c-5de45df2e919 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.812387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a212c-4754-419b-845d-541b50fd5a96 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.834886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.835683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.835963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.836238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.846139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.846792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.847073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.847181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:35.847349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.848173 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:35.848507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:35.849964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:35.855206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:35.856061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:35.856912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 251/505] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:35.857590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.883300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.887049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 255/506] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:35.887950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:35.964575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a385c-fdbc-4b9b-9dfe-8e57ff93e815 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.972008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:35.995484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b589903-9143-4370-bfdf-61e9bafd4397 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:35.997656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:35.998322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:35.998599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:35.998874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:35.999587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:35.999892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.001891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.013524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 252/507] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:36.014313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.033761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.034413 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.034702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.034985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.100545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.103724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.105570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.115961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e333a-bb3c-4e32-9ab4-3fb68a814f7b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.150402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.151186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.151490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.151760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.162301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.163874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:36.181610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:36.182520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:36.189144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:36.189144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:36.189144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:36.189144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:36.189144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 253/508] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:36.189144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.205438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 256/509] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:36.206278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.207676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.287351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7e89-7f61-458a-90ba-dbe273fe27e6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.300813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.303649 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38eed2-cb86-4c24-8154-2b9701ea02d9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.320890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.321549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.321839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.322118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.322864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:36.323175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.324585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.332609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 254/510] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:36.333401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.338366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.339014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.339299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.339573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.408038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.409528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.418155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.438213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7665ff-fe1e-4a22-bbc2-21aed9b42569 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.471136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.471925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.472214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.472520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.480207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.481719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:36.496607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:36.497521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:32:36.498536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:36.502601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 255/511] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:36.503289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.506111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.509757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 257/512] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:36.510557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.606783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aab7bb-6c32-430f-be6f-b442666188ee None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.610077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f58569-ca40-43a2-881f-cccfed57e516 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.641826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.642549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.642835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.643117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.643668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.643835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:36.644144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.644481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.644776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.645090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.645554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.655207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.655507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.657558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.659214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 256/513] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:36.660001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:36.675739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:36.676762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:36.677704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:36.677704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:36.677704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:36.677704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:36.677704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 258/514] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:36.677968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.731039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.762761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c7901-dd61-4176-9f4c-5fb1620a8945 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.777485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dcd532-2284-4dbf-8fdc-0adcc0bbfd5b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.798547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.799539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.799817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.800093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.810038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.810916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.811480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.811587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.811854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.812137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.813229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:36.813541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.814963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:36.828620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:36.829680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:36.830622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:36.830622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:36.830622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:36.830622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:36.830622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 257/515] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:36.830622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.841107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 259/516] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:36.841107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:36.883641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.930369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dd2e68-ebd8-4e5f-994e-2b76481b81e2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.936928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66363daf-b719-4401-8269-948e685e7ec5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:36.947891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:36.965875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.966662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.966941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.967222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.971953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:36.972665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:36.972957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:36.973235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:36.973943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.975460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.977434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:36.978870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:36.996369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:37.000713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:37.001861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:37.001861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:37.001861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:37.001861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:37.001861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 258/517] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:37.001861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.061634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 260/518] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:32:36 2022] POST /identity/v3/users => generated 247 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:37.063282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.134150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42087c3b-4df6-40eb-8658-09ea05e7ffbe None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.139073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:37.180860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af061525-c509-4310-8e0e-083c6782451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.181536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061525-c509-4310-8e0e-083c6782451c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.181819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061525-c509-4310-8e0e-083c6782451c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.182094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061525-c509-4310-8e0e-083c6782451c None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.182822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061525-c509-4310-8e0e-083c6782451c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:37.183128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061525-c509-4310-8e0e-083c6782451c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.184717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061525-c509-4310-8e0e-083c6782451c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.192619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82d5b4-2851-456c-b2a2-a26b12ff7974 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.198016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 259/519] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:37.203827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af061525-c509-4310-8e0e-083c6782451c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.232342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.233251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.233361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.233601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.234860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:37.235166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.236604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.252783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 261/520] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:37.255104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.284192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:37.332120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af061525-c509-4310-8e0e-083c6782451c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.366918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7ad89-7fcb-49d3-974b-dbfd5c0d70be None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.387065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.387636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.387932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.388213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.409391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.410064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.410355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.410635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.411816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:37.412154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.414005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.420940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:37.427660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 262/521] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:37.428234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.465782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.467256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.527568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:37.543975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524729b-be1d-4b7f-8dff-4e1d8dcb8e81 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.579331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.580126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.580434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.580729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.581717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 260/522] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:37.582634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.592612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.594780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:37.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:37.612683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:37.613604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 263/523] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:37.616125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.650945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:37.689269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d24646-b982-446f-a2ac-ed475843a321 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.722106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f896304-7785-4d54-822d-fb1fbccd302e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.724955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.725754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.726040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.726320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.733655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.735287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:37.749680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:37.751308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:37.752195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 261/524] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:37.753367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.765484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.766955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.767249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.767530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.775281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.776770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:37.792477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:37.793335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 264/525] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:37.799051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.807398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:37.864897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053cc199-9b62-4fb7-a237-24991175e7f1 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.890200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:37.902369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.903124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.903413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.903753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.907599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed93563-fae8-4d64-a34c-1f463615bc8b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:37.914204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.915675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:37.935535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:37.936521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:37.937630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:37.937630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:37.937630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:37.937630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:37.941827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 262/526] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:37.942929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:37.951248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:37.952482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:37.952950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:37.954033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:37.954980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:37.955445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:37.957083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:37.975140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 265/527] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:37.976112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.049763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:38.053873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa3c4c-d33b-4fb7-88b1-996054de9231 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.087025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035103b-71a4-4db1-a623-72e360dca0ea None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.089188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.089862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.090138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.090419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.091252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:38.091562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.093061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.111130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 263/528] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:38.111949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.131758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.132438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.132723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.133006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.133791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:38.134106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.135537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.148488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 266/529] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:38.153296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.157316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:38.229165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec3a0a-19da-448f-92a0-1d816b8fbc74 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.261856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab091cda-b9ee-4137-8958-a108f008c34b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.270805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.271482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.271773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.272098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.272866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:38.273187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.274560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.291620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 264/530] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:38.291620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.295643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:38.304827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.309559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.309559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.309559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.309559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b73296e3c73644f29eb0b4960a747c38) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:38.309559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.309559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.315457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 267/531] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/role_assignments?user.id=b73296e3c73644f29eb0b4960a747c38&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:38.316202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.434065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:38.435826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a4857-3aa1-40b1-81d6-4e10960853c1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.443762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfe221-1147-47c1-a1db-72f294d49c04 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.477597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.478263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.478556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.478843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.479690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=de8dfe694ffb4716a09db9e1e6d9a9a3) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:38.480333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.484458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.496889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 268/532] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/role_assignments?user.id=de8dfe694ffb4716a09db9e1e6d9a9a3&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:38.497570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.498510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.499007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.499492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.501328 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.594286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.596654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.596782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:38.702128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ed5d85-b348-444a-8b0c-4a509760a0a7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.746374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 265/533] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:38.746908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:38.752669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.753588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.755009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:38.755696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:38.756149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:38.766177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:38.768609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:38.788015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:38.789041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:38.789902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:38.792393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 269/534] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:38.798850 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:38.942488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67babd-fb3e-4ab0-b44a-ce755bb5f684 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.958904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:38.968490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebfe7f4-e233-4d27-8185-92e79b31c0b0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:38.997626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:38.999460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.001579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.002101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.003132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:39.005181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:39.006853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:39.034858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 270/535] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:39.036183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:39.050053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:39.051175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.051684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.052161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.078203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:39.080776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:39.116474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:39.117405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:39.118254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:39.118254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:39.118254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:39.118254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:39.132488 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 266/536] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:39.135495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:39.232173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:39.247817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf7c9d-2aba-4968-85b1-71cb226072db None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:39.317404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b13dcc-3366-4a2b-90db-39020245dedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:39.318446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13dcc-3366-4a2b-90db-39020245dedf None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.318961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13dcc-3366-4a2b-90db-39020245dedf None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.319439 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b13dcc-3366-4a2b-90db-39020245dedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.321629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b13dcc-3366-4a2b-90db-39020245dedf None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b20a4dea241b4c299fb947b946464ea4) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:39.322855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b13dcc-3366-4a2b-90db-39020245dedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:39.325135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b13dcc-3366-4a2b-90db-39020245dedf None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:39.334159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 271/537] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:39 2022] GET /identity/v3/role_assignments?user.id=b20a4dea241b4c299fb947b946464ea4&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:39.350951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ca1a6-d91b-4824-8e43-4d68c3e4dfbc None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:39.410547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27626d-075b-4af3-86c9-9af3042863a2 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.410891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27626d-075b-4af3-86c9-9af3042863a2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.411116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27626d-075b-4af3-86c9-9af3042863a2 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.413935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 272/538] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:39.418249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4703e-e53e-471d-ae10-947250b7e016 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.418542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4703e-e53e-471d-ae10-947250b7e016 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.418822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4703e-e53e-471d-ae10-947250b7e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.427308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:39.428371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.428907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.429389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.430340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:39.430856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:39.433156 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:39.446457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3bc4703e-e53e-471d-ae10-947250b7e016 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:39.450294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3bc4703e-e53e-471d-ae10-947250b7e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:39.458808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 267/539] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:39.464052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:39.501120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:39.544119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 273/540] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:39.568186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4703e-e53e-471d-ae10-947250b7e016 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:39.643150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6641654-09de-4eca-affd-66fb80849df7 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:39.654001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:39.709222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:39.710438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.710987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.711457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.725523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:39.727909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:39.730911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4703e-e53e-471d-ae10-947250b7e016 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:39.754646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:39.755509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:39.756339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:39.772763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 268/541] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:39.773933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:39.802576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:39.803800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:39.804283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:39.804799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:39.825491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:39.835796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:39.836736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:39.837516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:39.851315 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 274/542] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:39.852876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:39.885752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:39.969586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea7d03a-c0ae-4d0a-87cf-0cd67a8b7b58 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.002383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b6314-ac40-4668-808c-af98186c7675 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.008996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.010684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.011188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.011733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.012754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:40.013283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.015292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.029388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 275/543] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:40.030995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:40.086390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.087072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.087381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.087847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.088575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:40.088891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.090343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.129461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 269/544] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:40.133558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:40.135151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:40.143774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7301b8-bb60-4fec-8dae-6069ea5c806c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.183659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.184870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.185359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.185831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.190208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:40.200338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.202178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:40.223764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:40.224688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:40.225509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:40.225509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:40.225509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:40.225509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:40.227905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 276/545] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:40.234298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:40.384615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809323c-ecbb-4b3e-87d1-91e70f729828 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.401402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f654c2-9d1a-4f82-addb-1640fbcbee51 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.439792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.441863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.442670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.444862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.446474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=d7b2b76c46b640c0b19b46ed50d333ae) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:40.449631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.452209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.470827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 270/546] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:40 2022] GET /identity/v3/role_assignments?user.id=d7b2b76c46b640c0b19b46ed50d333ae&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:40.486669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.487734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.488249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.488781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.490113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:40.490847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.493371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.516567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 277/547] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:40.520240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:40.636969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:40.649077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c3b1f-a8b9-4728-bd93-824f93c50cbd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.690098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.691407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.691916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.692397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.701564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.703804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:40.720973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:40.721940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:32:40.722895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:40.728566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 271/548] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:40.731902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:40.756899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:40.858600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f5e6e-c8cb-4a03-b744-3b0060a61e94 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:40.896868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11ccfe-fe88-4b35-abb3-75f9877e9667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:40.897912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ccfe-fe88-4b35-abb3-75f9877e9667 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:40.898403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ccfe-fe88-4b35-abb3-75f9877e9667 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:40.898884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11ccfe-fe88-4b35-abb3-75f9877e9667 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:40.900009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ccfe-fe88-4b35-abb3-75f9877e9667 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:40.900568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ccfe-fe88-4b35-abb3-75f9877e9667 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:40.902293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11ccfe-fe88-4b35-abb3-75f9877e9667 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:40.921240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 278/549] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 2 13:32:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:40.929543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:41.064784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f52eef-081c-4a78-81d3-f69e998ac3db None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.065292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f52eef-081c-4a78-81d3-f69e998ac3db None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.065368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f52eef-081c-4a78-81d3-f69e998ac3db None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.066995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 279/550] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:41.071954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afb75a-9c0e-468f-b2ed-246595909751 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.072250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afb75a-9c0e-468f-b2ed-246595909751 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.072572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afb75a-9c0e-468f-b2ed-246595909751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.077247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc74ef-7348-4e16-922d-15f134692ff8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:41.090711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-08afb75a-9c0e-468f-b2ed-246595909751 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:41.092023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-08afb75a-9c0e-468f-b2ed-246595909751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:41.139572 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:41.142304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.143287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.144226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.198282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:41.198443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:41.211504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 280/551] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:41.235083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afb75a-9c0e-468f-b2ed-246595909751 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:41.269395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:41.271293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:41.404317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 272/552] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:41.413665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:41.450698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afb75a-9c0e-468f-b2ed-246595909751 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:41.501270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:41.511915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eca22-901b-4625-913d-cc000932610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:41.514327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eca22-901b-4625-913d-cc000932610f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.514327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eca22-901b-4625-913d-cc000932610f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.514327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eca22-901b-4625-913d-cc000932610f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.527493 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eca22-901b-4625-913d-cc000932610f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-551eca22-901b-4625-913d-cc000932610f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:41.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:41.537248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:41.538283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:41.543619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 281/553] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:41.543619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5f03b-815a-4431-a5e1-decd62fdd942 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.543619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5f03b-815a-4431-a5e1-decd62fdd942 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.543619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c5f03b-815a-4431-a5e1-decd62fdd942 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.543619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 282/554] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:41.548982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5f03b-815a-4431-a5e1-decd62fdd942 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:41.565580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dff0e-50cf-4f26-8790-9ebaf5ad28c0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:41.602834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51612e5b-c830-4d1d-a788-ef1f3b85deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:41.603639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612e5b-c830-4d1d-a788-ef1f3b85deb7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.603932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612e5b-c830-4d1d-a788-ef1f3b85deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.604214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51612e5b-c830-4d1d-a788-ef1f3b85deb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.607128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:41.617791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51612e5b-c830-4d1d-a788-ef1f3b85deb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:41.619080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51612e5b-c830-4d1d-a788-ef1f3b85deb7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-51612e5b-c830-4d1d-a788-ef1f3b85deb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:41.639262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:41.640973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 273/555] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5184-4d77-42a6-a64d-4b1ceaf9eca2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5184-4d77-42a6-a64d-4b1ceaf9eca2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.651256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5184-4d77-42a6-a64d-4b1ceaf9eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.661882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-73fe5184-4d77-42a6-a64d-4b1ceaf9eca2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:41.662783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-73fe5184-4d77-42a6-a64d-4b1ceaf9eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:41.677577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c5f03b-815a-4431-a5e1-decd62fdd942 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:41.714851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:41.715762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.716200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.716671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.717565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:41.718022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:41.720425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:41.731148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 283/556] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:41.732126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:41.742962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 274/557] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:41.744158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5184-4d77-42a6-a64d-4b1ceaf9eca2 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:41.777272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:41.852569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5184-4d77-42a6-a64d-4b1ceaf9eca2 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:41.881318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27d48a-521f-43b0-b918-3638d0f268eb None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:41.889152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:41.890200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.891195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.891697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.896830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:41.902652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:41.904288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:41.919097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:41.919763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:41.920201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:41.920514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:41.921243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:41.921553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:41.924098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:41.926751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:41.928137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:41.929062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:41.929062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:41.929062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:41.929062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:41.936065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 275/558] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:41.938018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:41.939962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 284/559] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:41.941026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.031160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.048863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb042c-8c62-4c41-b7ee-e802ec174f05 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.049981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b73e00-4ab7-428b-ad66-09166afd7bc2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.087136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.087773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9567b-4e6a-40ac-aa16-ac5a127db9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.088048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9567b-4e6a-40ac-aa16-ac5a127db9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.088336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9567b-4e6a-40ac-aa16-ac5a127db9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.088647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9567b-4e6a-40ac-aa16-ac5a127db9d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.089362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.089847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.090353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.091154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:42.091473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.092884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.100423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9567b-4e6a-40ac-aa16-ac5a127db9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:42.109245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 285/560] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:42.109245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-d0b9567b-4e6a-40ac-aa16-ac5a127db9d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:42.109580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:42.110641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:42.111493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:42.113357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 276/561] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:42.114647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadb9a-c9dd-45f2-b068-5e5815854b65 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.114941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadb9a-c9dd-45f2-b068-5e5815854b65 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.115220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eadb9a-c9dd-45f2-b068-5e5815854b65 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.120226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 277/562] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:42.120226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eadb9a-c9dd-45f2-b068-5e5815854b65 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.151428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.251558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423649a-5c03-4099-9e49-4373391e31f5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.255085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eadb9a-c9dd-45f2-b068-5e5815854b65 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.285160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.285874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.286160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.286447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.293676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.295112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.297770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b93675-68b5-4cca-b524-3ccf9df1419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.299013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93675-68b5-4cca-b524-3ccf9df1419d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.299452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93675-68b5-4cca-b524-3ccf9df1419d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.299977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b93675-68b5-4cca-b524-3ccf9df1419d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.308334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93675-68b5-4cca-b524-3ccf9df1419d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:42.309743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:42.310816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 286/563] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:42.311774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.312669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b93675-68b5-4cca-b524-3ccf9df1419d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-96b93675-68b5-4cca-b524-3ccf9df1419d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:42.333362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:42.334348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:42.335322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 278/564] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:42.335914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799a952-be3d-4601-afa4-d91d69bac490 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.336639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799a952-be3d-4601-afa4-d91d69bac490 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.336639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799a952-be3d-4601-afa4-d91d69bac490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.342948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.353769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e799a952-be3d-4601-afa4-d91d69bac490 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:42.355369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e799a952-be3d-4601-afa4-d91d69bac490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:42.425908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.430890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 279/565] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:42.431816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799a952-be3d-4601-afa4-d91d69bac490 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.444698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe433-2074-4d2e-9995-3327d6844858 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.483443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.484667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.485105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.485393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.486162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:42.486478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.487881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.502840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 287/566] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:42.503905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.567203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799a952-be3d-4601-afa4-d91d69bac490 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.603210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.603881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.604162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.604469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.605522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:42.605833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.607279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.608917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.618984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8855a12-0d0a-46cc-aea6-cd8ef320a56a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.619892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 280/567] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:42.624592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.666219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.667185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.667481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.667766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.668801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:42.669486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.671214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.699531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 288/568] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:42.699531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.718992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.728915 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f6c01-1c07-4e93-85d2-106705226245 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.770419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.771239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.771524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.771801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.786832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:42.794907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:42.795933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:42.797285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 281/569] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:42.798349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.818970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19afa31-b49e-40ad-b98a-189aee063cf5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.855301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.856097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.856381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.856686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.857285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.872618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.875650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:42.894429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:42.895526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:42.896454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:42.896454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:42.896454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:42.896454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:42.896454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 289/570] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:42.896454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:42.911259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0671d06-701d-42d8-b4d4-3c83a60f7253 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:42.950537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:42.951201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:42.951488 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:42.951766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:42.953643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=4599a196029c4f73b8428250cc19f8d3) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:42.954261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:42.955861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:42.962258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:42.971022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 282/571] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/role_assignments?user.id=4599a196029c4f73b8428250cc19f8d3&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:42.971022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.009595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9adaa36-bcb0-4141-8640-757451087336 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.050635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.051442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.051727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.052002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.064043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.065564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:43.086117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:43.087038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:43.088352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:43.088352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:43.088352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:43.088352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:43.088352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 290/572] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:43.088655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.114475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818eb23c-359b-427e-95f5-2a05cbbbd8fd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.134775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:43.153589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.154302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.154592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.154874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.155703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:43.155952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.157769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.167333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 283/573] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:43.168207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.242963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd841fe4-8e75-4465-bf3c-66e45588a302 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.264582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:43.287148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8704d88-90a1-47c4-a665-a6111025f87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.287814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704d88-90a1-47c4-a665-a6111025f87d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.288103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704d88-90a1-47c4-a665-a6111025f87d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.288385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8704d88-90a1-47c4-a665-a6111025f87d None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.289159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704d88-90a1-47c4-a665-a6111025f87d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:43.289512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704d88-90a1-47c4-a665-a6111025f87d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.290909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8704d88-90a1-47c4-a665-a6111025f87d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.307711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 291/574] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:43.307711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2cf3-a890-401b-9411-d14cf25f8d24 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.307711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2cf3-a890-401b-9411-d14cf25f8d24 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.307711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e2cf3-a890-401b-9411-d14cf25f8d24 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.307711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 292/575] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:43.308694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e2cf3-a890-401b-9411-d14cf25f8d24 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.317554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f879586-f676-4148-80ed-a3bfa0c89d5c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.356123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.357074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.357362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.357644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.358374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:43.358687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.360827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.378667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 284/576] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:43.379422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.420849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e2cf3-a890-401b-9411-d14cf25f8d24 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.425111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:43.458587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20188a1-13f3-43d7-87da-bfd89aadfb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.459388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20188a1-13f3-43d7-87da-bfd89aadfb48 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.459675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20188a1-13f3-43d7-87da-bfd89aadfb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.459955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20188a1-13f3-43d7-87da-bfd89aadfb48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.472288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20188a1-13f3-43d7-87da-bfd89aadfb48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.473789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20188a1-13f3-43d7-87da-bfd89aadfb48 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.491093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7719e4c4-5068-4718-98e2-ba8fa854c6e4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-c20188a1-13f3-43d7-87da-bfd89aadfb48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:43.492693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:43.495599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 293/577] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49b522-18fe-4c26-af9f-67afcbece03a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49b522-18fe-4c26-af9f-67afcbece03a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.497624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49b522-18fe-4c26-af9f-67afcbece03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.516368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0b49b522-18fe-4c26-af9f-67afcbece03a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:43.517701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0b49b522-18fe-4c26-af9f-67afcbece03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:43.533941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.534743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.535032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.535338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.543932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.545403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.546951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:43.560479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:43.561462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:32:43.563098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:43.567373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 285/578] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:43.568229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.592150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 294/579] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:43.593069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49b522-18fe-4c26-af9f-67afcbece03a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.688548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:43.691672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdcbf3-70e0-4060-97ae-9facf0965913 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.704428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49b522-18fe-4c26-af9f-67afcbece03a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.732017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.732913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.733225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.733506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.740730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.742179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.743014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.744058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.744846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.745314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.746298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:43.746831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.748664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:43.756948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:43.757883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:43.758808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 286/580] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:43.759384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.766773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 295/581] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:43.767465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.788614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:43.869418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6435e-2bb7-49a0-b83c-a93ff1899f9a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.872626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3dd1b-d61d-4cb4-9f94-c4b90373803b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:43.904788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.905567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.906033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.906420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.906564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:43.907213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:43.907312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:43.907496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:43.907602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:43.907769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:43.909003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:43.917911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:43.926337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:43.927305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:43.937014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:43.938947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 287/583] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:43.939035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 296/583] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:43.939118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.939190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:43.957242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.018897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.044644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e59311-2ff0-4bd4-93a2-9abec9fa7394 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.048325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6afaff6-5f71-4c57-8d7f-23a356d840c2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.083256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.083917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.084202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.084507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.085291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:44.085604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.085701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.086392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.086682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.086966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.087061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.096835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.098603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.099236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 288/584] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:44.100063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:44.120708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:44.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:44.122679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 297/585] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:44.123274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.194018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.221175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414fe35a-6309-4b0e-ad77-a4cdd9a5ffed None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.237323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28fbb5-8615-4211-a5a4-677ab12a3dfa None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.256160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.256978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.257264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.257554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.269468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.270938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.272661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.273328 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.273625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.273909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.274660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:44.274973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.276334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.282545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.291149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 298/586] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:44.291149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:44.291360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:44.292213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:44.293153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:44.293153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:44.293153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:44.293153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:44.293153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 289/587] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:44.293153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.400236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e23896-7baf-4ac1-aa1d-fa25463fd1b5 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.402017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f94ed4-8fd4-4a21-90da-5823a7ce55bb None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.436823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.439947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.440972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.445851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.445851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b73296e3c73644f29eb0b4960a747c38/roles/02b52b44bf4341fc9f58c196cadecfe9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.449615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.452937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.452937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.452937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.452937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:44.452937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.453848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.459077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=b73296e3c73644f29eb0b4960a747c38, role_id=02b52b44bf4341fc9f58c196cadecfe9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.460681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.472656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 290/588] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:44.473620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.556139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 299/589] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:32:44 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b73296e3c73644f29eb0b4960a747c38/roles/02b52b44bf4341fc9f58c196cadecfe9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:44.556139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.604564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b316a-0cce-43be-8312-121f6183c0e8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.608147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.654843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.656467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.656467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.656863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.669960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.679928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.680081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3c016-ccb5-4f19-8f1a-9597ec94029a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:44.694434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:44.695667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:44.696899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:44.696899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:44.696899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:44.696899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:44.703452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 291/590] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:44.704788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.724197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.725421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.725858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.726744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.727682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:44.728145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.730019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.748106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 300/591] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:44.750545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.756332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.832772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134fcff-71d6-44d9-a70e-0edf30bf261d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.871633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.872520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.872812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.873140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.877685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdc15a-b6f3-4468-9b0b-e047202373ba None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:44.884717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.886475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.891056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:44.907100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:44.908023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:44.909034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:44.909034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:44.909034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:44.909034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:44.909034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 292/592] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:44.909675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:44.920367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:44.921069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:44.921431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:44.922397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:44.923423 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:44.923812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:44.925307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:44.940236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 301/593] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:44.941377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.038216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:45.049063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee25c6-9c82-4691-afdc-9dde668d27e0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.071903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a15d14-3cf9-4bbf-b731-726bd3f68586 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.095989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.096909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.097269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.097616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.107265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.109403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.115621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.116571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.116988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.117312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.118008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:45.118323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.119701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:45.127085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:45.128864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:45.130975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:45.137441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 293/594] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:45.137441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.137869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 302/595] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:45.140260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.181519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:45.265033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27011536-2b4e-438a-9340-907ac7599a01 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.269676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e19ab-4a25-4001-be00-a80544dbfc1b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.304061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d04004-025b-4c7e-a2b8-3be182563b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.305152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.305657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.305940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.306077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04004-025b-4c7e-a2b8-3be182563b8f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.306259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.306359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04004-025b-4c7e-a2b8-3be182563b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.306627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04004-025b-4c7e-a2b8-3be182563b8f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.306999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:45.307302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.308774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.315437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d04004-025b-4c7e-a2b8-3be182563b8f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.316925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d04004-025b-4c7e-a2b8-3be182563b8f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.323162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 303/596] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:45.324450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-11d04004-025b-4c7e-a2b8-3be182563b8f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:45.333253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:45.334413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:32:45.335567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:45.336685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 294/597] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:45.337975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8305-79c7-4d92-89b6-cb7c4afcf81b None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.338269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8305-79c7-4d92-89b6-cb7c4afcf81b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.338551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c8305-79c7-4d92-89b6-cb7c4afcf81b None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.343776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 295/598] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:45.343776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c8305-79c7-4d92-89b6-cb7c4afcf81b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.357035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:45.431465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:45.441856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51460740-f271-488b-8cfd-9c3332f6fae8 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.455047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c8305-79c7-4d92-89b6-cb7c4afcf81b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.478039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.480060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.480470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.480904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.490724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.492317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.495262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb32d0f-bf1c-49b6-bcef-924ec16c14a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.496249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb32d0f-bf1c-49b6-bcef-924ec16c14a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.496566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb32d0f-bf1c-49b6-bcef-924ec16c14a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.496847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb32d0f-bf1c-49b6-bcef-924ec16c14a2 None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/de8dfe694ffb4716a09db9e1e6d9a9a3/roles/02b52b44bf4341fc9f58c196cadecfe9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.512745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb32d0f-bf1c-49b6-bcef-924ec16c14a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=de8dfe694ffb4716a09db9e1e6d9a9a3, role_id=02b52b44bf4341fc9f58c196cadecfe9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.514189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb32d0f-bf1c-49b6-bcef-924ec16c14a2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:45.514388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:45.515288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:45.516643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:45.522666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 304/599] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:45.522666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.615398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 296/600] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:32:45 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/de8dfe694ffb4716a09db9e1e6d9a9a3/roles/02b52b44bf4341fc9f58c196cadecfe9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:45.615398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a451d2-26da-4b9b-8cb8-db1750f86909 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.615398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a451d2-26da-4b9b-8cb8-db1750f86909 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.615398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a451d2-26da-4b9b-8cb8-db1750f86909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.639241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-40a451d2-26da-4b9b-8cb8-db1750f86909 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:45.640038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2e18a-c727-4be5-83f7-5464b6193ab1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.641266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-40a451d2-26da-4b9b-8cb8-db1750f86909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:45.684256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.685504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.685946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.686537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.688567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:45.689315 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.690959 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.719972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 305/601] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jun 2 13:32:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:45.719972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.728611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:45.731635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:45.741367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 297/602] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:45.742661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a451d2-26da-4b9b-8cb8-db1750f86909 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.836182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9babaa-70d4-4b71-94db-55db0b54159f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.856333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a451d2-26da-4b9b-8cb8-db1750f86909 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:45.877565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.878165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.878456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.878740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.879654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:45.879983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.882954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.901971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 306/603] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:45.902423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:45.902942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.903318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:45.903609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:45.903890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:45.923607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:45.925546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:45.950064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:45.951288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:45.952440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:45.952440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:45.952440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:45.952440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:45.954114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 298/604] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:45.956126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:45.995278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:46.022315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:46.047528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52006f-5116-4706-9296-3573113d8b6b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.086639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.087497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.087857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.088210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.092987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92b6b7-536f-4470-99e3-a3b7dfed956f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.099298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:46.107764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:46.109506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:46.110530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:46.116828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 307/605] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:46.118002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.140965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.142093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.142534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.142966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b20a4dea241b4c299fb947b946464ea4/roles/02b52b44bf4341fc9f58c196cadecfe9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.165134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=b20a4dea241b4c299fb947b946464ea4, role_id=02b52b44bf4341fc9f58c196cadecfe9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.167298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.231318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09b41e-e765-465b-8010-201f1a52d0f2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.264665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 299/606] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:32:45 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b20a4dea241b4c299fb947b946464ea4/roles/02b52b44bf4341fc9f58c196cadecfe9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:46.264665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.279089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:46.295800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.296604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.297250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.297535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.300128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:46.300467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.301896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.330389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 308/607] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:46.337253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.429176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:46.435649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6ac0-2aad-472f-a320-92e490bcc354 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.469057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfa774-492a-456e-8f85-7a543027979e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.473765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.474446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.474729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.475004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.475768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:46.476076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.477533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.490654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 300/608] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:46.497978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.516033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.517388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.517891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.518407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.527526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.529590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:46.547709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:46.549059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:46.550236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:46.552790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 309/609] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:46.569262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.633341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:46.672206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e14ab4-be26-4fc2-8e62-d73b7d163d7b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.701812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475d3e-da66-4f62-aa98-b33ab3fe3416 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:46.743992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.745245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.745771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.746283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.766504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.769094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.770035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:46.771008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:46.771546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:46.772591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:46.773873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:46.775381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:46.777805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:46.806617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:46.807596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:46.808528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:46.808528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:46.808528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:46.808528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:46.811228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 310/610] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:46.814022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 301/611] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:46.821438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.822763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:46.846215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:46.992645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7676840a-7528-4a48-8790-7b987c0c2aef None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.007939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.022221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428b672-d3b6-4fe6-8047-3cc3b98a5a8a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.038238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11a2ae-6c2c-4627-a9f0-a556d7bfbb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.039137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a2ae-6c2c-4627-a9f0-a556d7bfbb36 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.039426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a2ae-6c2c-4627-a9f0-a556d7bfbb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.039705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11a2ae-6c2c-4627-a9f0-a556d7bfbb36 None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/d7b2b76c46b640c0b19b46ed50d333ae/roles/02b52b44bf4341fc9f58c196cadecfe9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.058059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11a2ae-6c2c-4627-a9f0-a556d7bfbb36 None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=d7b2b76c46b640c0b19b46ed50d333ae, role_id=02b52b44bf4341fc9f58c196cadecfe9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.059519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11a2ae-6c2c-4627-a9f0-a556d7bfbb36 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.079676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.080371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.084789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.084789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.084789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:47.084789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.084789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.096611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 302/612] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:47.105764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.157149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 311/613] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:32:46 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/d7b2b76c46b640c0b19b46ed50d333ae/roles/02b52b44bf4341fc9f58c196cadecfe9 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:47.181914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.193787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbafc-b9d5-48a7-8498-3c36a34484b7 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.194116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbafc-b9d5-48a7-8498-3c36a34484b7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.194349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554fbafc-b9d5-48a7-8498-3c36a34484b7 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.196061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 312/614] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:47.201907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979c71-0748-45ee-9ec7-5664ac3f7a11 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.202585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979c71-0748-45ee-9ec7-5664ac3f7a11 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.203131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979c71-0748-45ee-9ec7-5664ac3f7a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.219204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fecfe7-f2b4-43d2-ac8a-66db417192e4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.241601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ef979c71-0748-45ee-9ec7-5664ac3f7a11 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:47.243281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ef979c71-0748-45ee-9ec7-5664ac3f7a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:47.261711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.262532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.262820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.263099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.272298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.273945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:47.289736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:47.290759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:47.292379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 303/615] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:47.297864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.445912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaafd44-07ef-45ed-b60f-1aa6b9efdf40 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.472790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 313/616] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:47.501148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef979c71-0748-45ee-9ec7-5664ac3f7a11 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.502663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.508167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.509039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.509545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.510035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.511039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:47.511384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.512963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.550352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 304/617] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:47.556218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.655070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:47.669074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef979c71-0748-45ee-9ec7-5664ac3f7a11 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.710865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.711995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.722599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.722599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.746065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:47.761050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:47.762037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:47.762859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:47.763745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 314/618] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:47.770138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.775491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b00fb49-f1d9-443b-9220-338f242483f6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.857254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.858091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.858371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.858659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.897474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.898959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:47.938902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25c9a9-c7e6-4704-8471-adfd49369d58 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:47.954642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:47.955623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:47.956567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:47.956567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:47.956567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:47.956567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:47.969489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 305/619] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:47.990359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:47.990604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:47.990704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:47.991312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:47.991312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:47.992298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:47.992719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:47.994509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.006537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 315/620] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:48.011740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.040773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.092761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.179899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fafb49-04ee-422c-8546-ee94665b6df0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.216066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd19d4f-fdfe-46bc-9600-117289bb070e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.230698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff39d1a-a612-4791-b2c9-1528381c6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.231529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39d1a-a612-4791-b2c9-1528381c6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.231818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39d1a-a612-4791-b2c9-1528381c6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.232178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff39d1a-a612-4791-b2c9-1528381c6ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.247797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff39d1a-a612-4791-b2c9-1528381c6ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.250823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff39d1a-a612-4791-b2c9-1528381c6ed2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.263812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.264424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.270581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.270581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.270581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:48.270581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.270581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-2ff39d1a-a612-4791-b2c9-1528381c6ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:48.277982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:48.278916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:48.279818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:48.279818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:48.279818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:48.279818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:48.282863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 316/621] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:48.284587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585bac-992b-4e36-b9f4-c7050de5d50e None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.285123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585bac-992b-4e36-b9f4-c7050de5d50e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.285670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585bac-992b-4e36-b9f4-c7050de5d50e None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.287243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 317/623] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:48.288178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585bac-992b-4e36-b9f4-c7050de5d50e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.288625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 306/623] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:48.289979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.358817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.404943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585bac-992b-4e36-b9f4-c7050de5d50e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.414958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.420286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f98580-d527-4c19-81d0-41c8189cec2f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.444281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbe151-e92b-42e4-97c6-da4f2c4012f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.445372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe151-e92b-42e4-97c6-da4f2c4012f8 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.445915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe151-e92b-42e4-97c6-da4f2c4012f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.446551 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbe151-e92b-42e4-97c6-da4f2c4012f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.447488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbe151-e92b-42e4-97c6-da4f2c4012f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:48.448041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbe151-e92b-42e4-97c6-da4f2c4012f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.450508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbe151-e92b-42e4-97c6-da4f2c4012f8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.464195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.465021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.465305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.465746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.466257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 318/624] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:48.468139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b922-c43c-48f4-82c2-365e51d16f44 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.469516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b922-c43c-48f4-82c2-365e51d16f44 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.470075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757b922-c43c-48f4-82c2-365e51d16f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.474768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.476472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.490048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-4757b922-c43c-48f4-82c2-365e51d16f44 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:48.491608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4757b922-c43c-48f4-82c2-365e51d16f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:48.506928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:48.508300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:48.509259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:48.511789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 307/625] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:48.512863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.600730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 319/626] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:48.600730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757b922-c43c-48f4-82c2-365e51d16f44 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.653408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de91ec8-62b4-4fc7-aa9f-dc29cf2c742b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.661785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.697690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.698632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.698946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.699333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.709661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.711383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.718322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757b922-c43c-48f4-82c2-365e51d16f44 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:48.731019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:48.732034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 308/627] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:48.733685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.755239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.768556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.769558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.769951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.770507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.772268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:48.772859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.774510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:48.792307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 320/628] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:48.793780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.847870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09b0f8-2b29-4b7b-9186-241190e4515d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.886904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.888139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.888139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.888515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.900492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:48.909619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:48.910734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:48.911794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:48.913466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 309/629] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:48.914112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:48.932278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84199a-cab6-4b6f-86ce-57ef20501fa1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:48.950674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:48.980260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:48.981800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:48.982455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:48.982932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:48.984915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:48.985649 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:48.987250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.002875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:49.011820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 321/630] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:32:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:49.012885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.030264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd9996f-2be4-4df1-80d2-e2470a044143 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.071908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cab9bfa-1339-4d6c-b083-c6de75630586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.073031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9bfa-1339-4d6c-b083-c6de75630586 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.073783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9bfa-1339-4d6c-b083-c6de75630586 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.073783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cab9bfa-1339-4d6c-b083-c6de75630586 None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/4599a196029c4f73b8428250cc19f8d3/roles/02b52b44bf4341fc9f58c196cadecfe9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.090326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab9bfa-1339-4d6c-b083-c6de75630586 None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=4599a196029c4f73b8428250cc19f8d3, role_id=02b52b44bf4341fc9f58c196cadecfe9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:49.091725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cab9bfa-1339-4d6c-b083-c6de75630586 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.133767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a9a00e-4094-44c4-83dc-54e29347473f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.167718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.168314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.168648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.168924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.169660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:49.169963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:49.171317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.179803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 322/631] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:49.180730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.200446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 310/632] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:32:48 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/4599a196029c4f73b8428250cc19f8d3/roles/02b52b44bf4341fc9f58c196cadecfe9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:32:49.200446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98d614-4905-4a02-8fb7-800b257ebc50 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.200446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98d614-4905-4a02-8fb7-800b257ebc50 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.200446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98d614-4905-4a02-8fb7-800b257ebc50 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.200446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 311/633] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:49.200446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98d614-4905-4a02-8fb7-800b257ebc50 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.228579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:49.324470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9ffe2-aafe-4ae9-8f1f-e0cc458d11b9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.330538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c98d614-4905-4a02-8fb7-800b257ebc50 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.369586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:49.370071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.371370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.371806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.372279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.380072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c6c3e-103b-45fc-99fa-93c5b38f1475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.380899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c6c3e-103b-45fc-99fa-93c5b38f1475 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.381184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c6c3e-103b-45fc-99fa-93c5b38f1475 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.386781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c6c3e-103b-45fc-99fa-93c5b38f1475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.395924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c6c3e-103b-45fc-99fa-93c5b38f1475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:49.397813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c6c3e-103b-45fc-99fa-93c5b38f1475 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-d27c6c3e-103b-45fc-99fa-93c5b38f1475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:49.424703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:49.426390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:49.428256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:49.428256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:49.428256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:49.428256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:49.431918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 312/634] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:49.434131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ccbc-1afc-461e-9beb-b032141cbe39 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.434672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ccbc-1afc-461e-9beb-b032141cbe39 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.435205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8ccbc-1afc-461e-9beb-b032141cbe39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.462401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-9af8ccbc-1afc-461e-9beb-b032141cbe39 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:49.463611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9af8ccbc-1afc-461e-9beb-b032141cbe39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:49.494132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:49.498969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.557682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:49.561507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 313/635] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:49.569809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8ccbc-1afc-461e-9beb-b032141cbe39 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.653272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 323/636] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:49.654466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.702463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8ccbc-1afc-461e-9beb-b032141cbe39 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.715548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:49.745878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.747070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.747814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.748296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.750514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:49.751463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:49.754251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.774687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 314/637] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:49.775864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.794099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63063878-3369-48e1-9a7b-20749aeb5e8a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.826346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:49.832798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.834052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.834502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.835327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.849756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:49.859927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:49.861146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:49.861972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:49.864552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 324/638] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:49.865588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:49.902031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cc7ee2-0bb6-4d5a-9519-1ef72b1dae56 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.937969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:49.938858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:49.939253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:49.939525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:49.950995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:49.953201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:49.971034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca0a44-fe50-494b-b125-1783cf30dbc8 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:49.972269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:49.973457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:49.974865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:49.974865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:49.974865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:49.974865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:49.974865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 315/639] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:49.978659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.003256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.012322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b49f0d-e44c-4517-a461-44d57a75cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.013219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49f0d-e44c-4517-a461-44d57a75cb89 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.013573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49f0d-e44c-4517-a461-44d57a75cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.014029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b49f0d-e44c-4517-a461-44d57a75cb89 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.022712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b49f0d-e44c-4517-a461-44d57a75cb89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.024247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b49f0d-e44c-4517-a461-44d57a75cb89 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-82b49f0d-e44c-4517-a461-44d57a75cb89 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:50.039606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:50.040827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 02 13:32:50.042034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:50.044008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 325/640] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:50.045399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd1cf6-b15f-459d-92aa-999eb0ca9c04 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.045683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd1cf6-b15f-459d-92aa-999eb0ca9c04 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.045963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd1cf6-b15f-459d-92aa-999eb0ca9c04 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.047895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 326/641] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:50.048425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd1cf6-b15f-459d-92aa-999eb0ca9c04 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.095781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3fc60-3c65-417c-af25-7f04e6c1c8ca None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.109843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.137703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.138722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.139015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.139609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.141210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:50.141528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.143084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.157257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 316/642] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:50.158328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.163796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd1cf6-b15f-459d-92aa-999eb0ca9c04 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.202064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652dc32-aae4-4979-a372-fd01a63cfe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.203313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652dc32-aae4-4979-a372-fd01a63cfe68 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.203497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652dc32-aae4-4979-a372-fd01a63cfe68 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.203772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652dc32-aae4-4979-a372-fd01a63cfe68 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.204529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652dc32-aae4-4979-a372-fd01a63cfe68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:50.204820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652dc32-aae4-4979-a372-fd01a63cfe68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.206182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652dc32-aae4-4979-a372-fd01a63cfe68 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.218852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 327/643] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:50.220630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbfe4e-80e2-4fee-8823-677b2d216e75 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.220957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbfe4e-80e2-4fee-8823-677b2d216e75 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.221207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbfe4e-80e2-4fee-8823-677b2d216e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.238008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5afbfe4e-80e2-4fee-8823-677b2d216e75 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:50.239209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5afbfe4e-80e2-4fee-8823-677b2d216e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:50.254422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.270420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b608a-3f45-4f3c-afef-b3bfd9720535 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.320425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 328/644] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:50.320425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbfe4e-80e2-4fee-8823-677b2d216e75 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.321711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.322605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.322893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.323175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.324027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:50.324343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.325897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.346537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 317/645] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:50.347752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.372117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.441033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbfe4e-80e2-4fee-8823-677b2d216e75 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.460674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f21247-3717-4743-8e52-ac31056f9abb None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.478919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.479980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.480266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.480577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.495027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.496566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.500638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.501452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.501741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.502019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.509169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.510639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:50.517801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:50.518705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:50.519777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:50.519777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:50.519777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:50.519777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:50.519777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 329/646] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:50.520547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:50.529607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:50.530536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:50.531612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:50.535539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 318/647] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:50.536363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.539246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.627497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.634886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551e262-384f-448c-bac4-44a010e6788a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.646442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efc5fc-bfc0-4252-9154-09730482249e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.676614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.677621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.678224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.678595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.682572 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.683220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.683507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.683789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.689936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:50.697711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:50.698643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 330/648] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:50.700052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.764067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.766044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.768046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.808312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c3c59-3334-46f0-b751-c18a2acc7b8d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.843836 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:50.844486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:50.844773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:50.845050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:50.845794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:50.846072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:50.847442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:50.859519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 331/649] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:50.860324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.878608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:50.883585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 319/650] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:50.883585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:50.971987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71d647-7a5b-43bd-90ad-34630be201a5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.988711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e7b24-e367-4a9d-9ec1-aa0b069ef294 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:50.990379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.009337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.010088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.010377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.010654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.011437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:51.011746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.013203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.025929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 332/651] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:51.026750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.031752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.032703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.033181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.033770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.034530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:51.034840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.036223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.044762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 320/652] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:51.050462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.109608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.133751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8adf6-f289-4b13-a50f-a3d8d3b348f2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.167075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d943c-2954-46ed-947f-19a66f81eba6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.172173 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.173016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.173300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.173633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.182632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.184157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:51.198251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:51.199250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:51.200169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 333/653] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:51.200885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.209513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.210303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.210585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.210896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.223192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.224712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:51.244578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:51.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:51.246752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:51.246752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:51.246752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:51.246752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:51.246752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 321/654] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:51.247168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.268291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.322097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804de80-ee3b-453a-a013-02ace028b8e2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.354776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95251855-8447-4a2c-8713-fd8d4cad273e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.357887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.358659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.359717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.360164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.361130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b73296e3c73644f29eb0b4960a747c38) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:51.361549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.363515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.366277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.370940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 334/655] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/role_assignments?user.id=b73296e3c73644f29eb0b4960a747c38&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:51.371865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.407906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.410084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.410549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.410975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.425185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.427043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:51.448151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:51.449390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:51.450503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:51.450503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:51.450503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:51.450503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:51.456862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 322/656] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:51.458490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.498943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81862f-8ade-4b58-a9fe-c78048893bf2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.544177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.544944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.545233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.545512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.545953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.547061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:51.547374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.549811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.575547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 335/657] 10.222.0.33 () {56 vars in 1137 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:51.576122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.583957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ed8a3-ed6e-4ef0-ace4-a95abb24f8bf None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.626004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6c9158-5090-4fb2-b57e-41c0066b5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.626674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9158-5090-4fb2-b57e-41c0066b5906 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.626953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9158-5090-4fb2-b57e-41c0066b5906 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.627234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6c9158-5090-4fb2-b57e-41c0066b5906 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.628340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c9158-5090-4fb2-b57e-41c0066b5906 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:51.628521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c9158-5090-4fb2-b57e-41c0066b5906 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.629852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6c9158-5090-4fb2-b57e-41c0066b5906 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.643408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 323/658] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:51.644938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509bd3-c968-430e-8df8-d8673d4ca6e5 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.645225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509bd3-c968-430e-8df8-d8673d4ca6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.645501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509bd3-c968-430e-8df8-d8673d4ca6e5 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.646752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 324/659] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:51.647501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34509bd3-c968-430e-8df8-d8673d4ca6e5 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.652595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.704323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c81991-8437-41e3-9b65-04b15b7f3a2f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.741723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.742419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.742680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.742966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.743693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:51.744004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.745401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.757718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34509bd3-c968-430e-8df8-d8673d4ca6e5 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.762612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 336/660] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:51.762612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:51.788315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.796666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.797469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.804333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.804333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.869854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.871242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.881827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bf5c3e-fc83-4796-a0cd-9c96c64e1436 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:51.900420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:51.918597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28cbae-5a08-4ab6-961c-ff6c1ae7dee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:51.919751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cbae-5a08-4ab6-961c-ff6c1ae7dee6 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.920487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cbae-5a08-4ab6-961c-ff6c1ae7dee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.920782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28cbae-5a08-4ab6-961c-ff6c1ae7dee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.928561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cbae-5a08-4ab6-961c-ff6c1ae7dee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:51.930129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28cbae-5a08-4ab6-961c-ff6c1ae7dee6 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-7e28cbae-5a08-4ab6-961c-ff6c1ae7dee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:51.944729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:51.945613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:51.946523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 337/661] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:51.947453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ad07d-75da-4b8e-8bd7-564831137045 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:51.947747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ad07d-75da-4b8e-8bd7-564831137045 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:51.948032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ad07d-75da-4b8e-8bd7-564831137045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:51.965314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-840ad07d-75da-4b8e-8bd7-564831137045 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:51.966512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-840ad07d-75da-4b8e-8bd7-564831137045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:51.989206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 325/662] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:51.990053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.018468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:52.044912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 338/663] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:52.057271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ad07d-75da-4b8e-8bd7-564831137045 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.098904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0935a0d-ed01-48e9-bdd1-42f77bda86f2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.135331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.136044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.136342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.136653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.144555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.146053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:52.161454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:52.168601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 326/664] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:52.169809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.181212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ad07d-75da-4b8e-8bd7-564831137045 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.188812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:52.218139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.219522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.219813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.220629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.222128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:52.222938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.224996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.242662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 339/665] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:52.242662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.269251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:52.281557 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b539ae-b48f-44f5-b382-be3f44d3407d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.317343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.318133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.318424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.318711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.330034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.331497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:52.350513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:52.351438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:52.352856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:52.352856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:52.352856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:52.352856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:52.353094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18aa970-d0d1-4e3b-91a9-af923972ad4f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.353533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 327/666] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:52.353533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.393473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.394627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.395123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.395605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.406680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:52.414762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:52.415726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:52.416621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 340/667] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:52.417336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.450309 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:52.463151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b97d6-db5f-400e-9114-996c5f70a7e8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.503762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.504469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.504764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.505048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.505888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:52.506233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.508088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.518709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:52.527123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 328/668] 10.222.0.33 () {56 vars in 1139 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:52.530122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.538241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35c485-1588-4dda-a5dc-86d7beef4826 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.574079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.574721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.575007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.575283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.576099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=de8dfe694ffb4716a09db9e1e6d9a9a3) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:52.576427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.577971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.592472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 341/669] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/role_assignments?user.id=de8dfe694ffb4716a09db9e1e6d9a9a3&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:52.592472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.663569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2359f-5be5-44f2-abae-f2642d1e4f7f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.714816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.715724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.716079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.716472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.717294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:52.717667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.720312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.727873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:52.740670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 329/670] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:52.741351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ffbb9-8059-4bdc-8f24-7941d4c57474 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.742235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.800069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.801101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.801494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.801877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.802882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:52.803292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:52.805108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:52.815367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 342/671] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:52.820170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:52.821191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:52.887125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa4fc7-fdd9-4200-9c62-56a4a6b497f9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:52.932815 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:52.933708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:52.934151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:52.934428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:52.960558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da708313-fc5d-4bfe-ba65-56856fe77cb3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.008617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.009879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.010403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.010792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.021332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.023685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.024342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.025999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:53.043049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:53.044133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:53.045283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:53.047828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 343/672] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:53.048757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.067466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:53.099445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:53.160492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 330/673] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:53.161618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.178212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79e490-b5d0-474e-b535-5d99adf503a9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.219213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.220420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.220878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.221393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.233222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.235761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:53.255577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:53.256732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:53.257843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:53.257843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:53.257843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:53.257843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:53.259696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 344/674] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:53.260652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.303462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80a2a62-d368-4dc6-b93f-8668dda98da3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.332141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:53.349976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.351100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.351804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.352184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.353111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:53.353682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.356173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.376435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 331/675] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:53.376435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.380169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4206f-8e98-43be-b498-23b101262330 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.398806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:53.419542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.420709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.421140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.421628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.433006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.434692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:53.457898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:53.459054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:53.460135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:53.460135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:53.460135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:53.460135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:53.462933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 345/676] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:53.466669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.520704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad131d-b205-424f-b460-2bba8aa3d6df None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.558383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.559406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.559837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.560257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.561222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:53.561670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.563906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.577200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 332/677] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:53.578394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.603001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bffa17-ef45-4858-b3e5-519f843c9e73 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.621721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:53.641646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.642608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.643144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.643565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.644693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b20a4dea241b4c299fb947b946464ea4) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:53.645172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.646929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.657361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 346/678] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/role_assignments?user.id=b20a4dea241b4c299fb947b946464ea4&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:53.658410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.683203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:53.711627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5956ab-8ef9-495f-8ff9-522e42f32aaa None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.756681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.757552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.757947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.758335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.759200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:53.759616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.762249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.778031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 333/679] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:53.785836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.872668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab7897-41b0-4254-b9b9-a54cda170ff7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.917460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64648f0c-4914-48a5-b909-dba21037bcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.918261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648f0c-4914-48a5-b909-dba21037bcae None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.918549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648f0c-4914-48a5-b909-dba21037bcae None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.918828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64648f0c-4914-48a5-b909-dba21037bcae None admin] PATH_INFO: `/v3/users/swift` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.926882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f0717-6cab-4f7b-a4ab-279ed899686f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:53.928930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64648f0c-4914-48a5-b909-dba21037bcae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.930565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64648f0c-4914-48a5-b909-dba21037bcae None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-64648f0c-4914-48a5-b909-dba21037bcae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:53.946740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:53.947735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:32:53.948701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:53.950019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 347/680] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:53.955154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8dcf-51e1-4326-86ec-38773f294756 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.955154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8dcf-51e1-4326-86ec-38773f294756 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.955154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e8dcf-51e1-4326-86ec-38773f294756 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.955154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 348/681] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:53.955906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e8dcf-51e1-4326-86ec-38773f294756 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:53.974451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44042038-127e-4efc-a8d5-a8a7cb583364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:53.975553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042038-127e-4efc-a8d5-a8a7cb583364 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:53.976018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042038-127e-4efc-a8d5-a8a7cb583364 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:53.976534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042038-127e-4efc-a8d5-a8a7cb583364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:53.985272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44042038-127e-4efc-a8d5-a8a7cb583364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:53.986736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44042038-127e-4efc-a8d5-a8a7cb583364 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:53.988658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-44042038-127e-4efc-a8d5-a8a7cb583364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:54.005004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:54.007472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 334/682] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f50b2d-38a0-4a27-9736-5c32f052a7d0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.009564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f50b2d-38a0-4a27-9736-5c32f052a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.010227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f50b2d-38a0-4a27-9736-5c32f052a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.020053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:54.027897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-37f50b2d-38a0-4a27-9736-5c32f052a7d0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:54.029146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-37f50b2d-38a0-4a27-9736-5c32f052a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:54.094883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e8dcf-51e1-4326-86ec-38773f294756 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:54.108602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 335/683] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:54.110239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f50b2d-38a0-4a27-9736-5c32f052a7d0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:54.156488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:54.157287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.157574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.158001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.159177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:54.159624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:54.161463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:54.184304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 349/684] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 2 13:32:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:54.188726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:54.257808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f50b2d-38a0-4a27-9736-5c32f052a7d0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:54.296978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:54.306450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:54.307161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.307448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.307728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.308561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:54.313877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:54.313877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:54.315491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:54.319552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539cace-50b1-4319-8239-577c05c15edd None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:54.325152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 336/685] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:54.326183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:54.363267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:54.364149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.364344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.364646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.376030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:54.383822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:54.385455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:54.386433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:54.390536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 350/686] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:54.391534 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:54.455054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4df18-ec35-40e6-b390-c6836288fa5e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:54.500192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9de2f-430d-40b3-8246-c5acdc92713e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:54.501945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:54.504267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.504737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.505199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.542257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:54.542836 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.543128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.543410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.544242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=d7b2b76c46b640c0b19b46ed50d333ae) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:54.544604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:54.546128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:54.560868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 351/687] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:54 2022] GET /identity/v3/role_assignments?user.id=d7b2b76c46b640c0b19b46ed50d333ae&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:54.562626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:54.586535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:54.603683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:54.606254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:54.612505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:54.747363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 337/688] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:54.755759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:54.818822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85668593-9f39-4273-80bc-54de6fc06bdf None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:54.873415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:54.874100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.874570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.876178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.877015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:54.877331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:54.878715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:54.887731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 352/689] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:54.892120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:54.894270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:54.910972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526b0fe-11a6-4ce3-8bfb-178473da7b5e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:54.961149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:54.962610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:54.963053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:54.963777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:54.985196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:54.986932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.006879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:55.014038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:55.014992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:55.016722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:55.016722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:55.016722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:55.016722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:55.021982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 338/690] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:55.025811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.033223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ec31a-c95f-4fa9-b301-a94a859756a8 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.083266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f002a6-a8da-4804-9148-038a30b8cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.083266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f002a6-a8da-4804-9148-038a30b8cc8f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.083266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f002a6-a8da-4804-9148-038a30b8cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.083266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f002a6-a8da-4804-9148-038a30b8cc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.099410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f002a6-a8da-4804-9148-038a30b8cc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.101104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f002a6-a8da-4804-9148-038a30b8cc8f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-57f002a6-a8da-4804-9148-038a30b8cc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:55.119891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:55.120986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:55.122093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:55.122093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:55.122093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:55.122093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:55.122093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 353/691] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:55.122667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c0b35-137e-4962-8685-32f2f2da17de None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.123167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c0b35-137e-4962-8685-32f2f2da17de None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.123279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c0b35-137e-4962-8685-32f2f2da17de None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.129773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 354/692] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:55.130577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c0b35-137e-4962-8685-32f2f2da17de None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.175917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f399-5797-45ae-916c-bb8bcbdf5b00 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.223654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274df40-fc1c-4294-b324-b6bc07a2ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.224859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274df40-fc1c-4294-b324-b6bc07a2ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.225291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274df40-fc1c-4294-b324-b6bc07a2ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.226115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274df40-fc1c-4294-b324-b6bc07a2ccb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.227018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274df40-fc1c-4294-b324-b6bc07a2ccb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:55.227471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274df40-fc1c-4294-b324-b6bc07a2ccb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.229854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274df40-fc1c-4294-b324-b6bc07a2ccb6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.242541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:55.244472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c0b35-137e-4962-8685-32f2f2da17de None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.248544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 339/693] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:55.250307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61314-db3f-465f-9119-193352eb8390 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.250793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61314-db3f-465f-9119-193352eb8390 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.251247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f61314-db3f-465f-9119-193352eb8390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.272919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-86f61314-db3f-465f-9119-193352eb8390 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:55.274485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-86f61314-db3f-465f-9119-193352eb8390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:55.291112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.291830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.292118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.292566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.293632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:55.293992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.295941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.299003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:55.317218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 355/694] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:55.317218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.362625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 340/695] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:55.363936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f61314-db3f-465f-9119-193352eb8390 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.444892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f82f0c-000b-40e5-af54-56efcb593219 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.486935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.487780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.488010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.488286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.490479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f61314-db3f-465f-9119-193352eb8390 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.499253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.501332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:55.516621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:55.517517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:55.518427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:55.522717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 356/696] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:55.523656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.528966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:55.536294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.537439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.543636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.543636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.546236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.547920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:32:55.565821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:55.566812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:32:55.567747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:55.571548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 341/697] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:55.577129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.586256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:55.635198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3db52-9a83-41e2-82f9-be455a82999b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.674584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.675387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.675670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.675944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.690928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb3b6c-5947-4bbb-9ced-f23520a18c50 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.691483 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.693303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:55.716887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:55.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:55.719540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:55.719540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:55.719540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:55.719540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:55.723935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 357/698] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:55.725260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.742028 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.742700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.742986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.743266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.744342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:55.744697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.746416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.763385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 342/699] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:55.764925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.821888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:55.872348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980cdf-2489-4e3d-ba77-6c1fac206efc None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.880544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1a4ae-e03f-46c2-ab41-660c4693c1b0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:55.884999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:55.911022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.912029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.912601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.913214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.914358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:55.914875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.916939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.923880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:55.924576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:55.924863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:55.925624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:55.926357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:55.926672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:55.928335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:55.944624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 343/700] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:55.945214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 358/701] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:55.945568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:55.949171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:56.068441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c37268-9260-479b-9fff-6cb57f9fd3ca None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:56.073746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3982b26-8026-4244-8dcb-8d54057491bc None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:56.080973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:56.106094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:56.107157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.107652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.108136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.109780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=4599a196029c4f73b8428250cc19f8d3) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:56.110447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:56.113082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:56.116728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c6a26-b55e-4394-a8aa-881a4c25b12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:56.117451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6a26-b55e-4394-a8aa-881a4c25b12a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.117939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6a26-b55e-4394-a8aa-881a4c25b12a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.118416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c6a26-b55e-4394-a8aa-881a4c25b12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.120723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 344/702] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/role_assignments?user.id=4599a196029c4f73b8428250cc19f8d3&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:56.121731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:56.187177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:56.227223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c6a26-b55e-4394-a8aa-881a4c25b12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:56.228899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46c6a26-b55e-4394-a8aa-881a4c25b12a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:56.294311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b5b97-cbae-4849-a7d9-e993fb238c8f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:56.347261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83da42cf-da91-4dac-8571-151c884a55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:56.348369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da42cf-da91-4dac-8571-151c884a55eb None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.348973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da42cf-da91-4dac-8571-151c884a55eb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.349263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83da42cf-da91-4dac-8571-151c884a55eb None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.349981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da42cf-da91-4dac-8571-151c884a55eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:56.351450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83da42cf-da91-4dac-8571-151c884a55eb None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:56.356931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 359/703] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:32:56.358293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f41b-2356-4610-bf69-92df97e80503 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.358588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f41b-2356-4610-bf69-92df97e80503 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.364103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071f41b-2356-4610-bf69-92df97e80503 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.364103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 360/704] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:56.365779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f41b-2356-4610-bf69-92df97e80503 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:56.433532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 345/705] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:32:56 2022] POST /identity/v3/users => generated 254 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:32:56.435160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b152c04-5892-4266-8a8c-a65c45475942 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.435294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b152c04-5892-4266-8a8c-a65c45475942 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.435530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b152c04-5892-4266-8a8c-a65c45475942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.464125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4b152c04-5892-4266-8a8c-a65c45475942 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:56.465475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4b152c04-5892-4266-8a8c-a65c45475942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:56.465889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:56.502441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:56.517037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071f41b-2356-4610-bf69-92df97e80503 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:56.566036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 346/706] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:56.583385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:56.584523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.584992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.585434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.597930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:56.600677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b152c04-5892-4266-8a8c-a65c45475942 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:56.604129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:32:56.647158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:56.648294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:56.649305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:32:56.649305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:32:56.649305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:32:56.649305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:56.653533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 361/707] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:56.658206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:56.768753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b152c04-5892-4266-8a8c-a65c45475942 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:56.787312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df306d-69a1-4279-ae2e-37d0ab8c63e1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:56.806117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:56.814018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:56.815416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.816840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.816840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.817243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:56.819293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:56.826331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:56.827082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:56.827951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:56.828327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:56.829355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:56.829728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:56.831194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:56.836462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:56.837690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:56.838764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 347/708] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jun 2 13:32:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:56.845044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:56.847222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 362/709] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:56.853066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:56.879692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:57.037822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9bc07-c73a-4fde-95df-3bb98072a841 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:57.053016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9472c-21aa-46b2-b596-a28dc361e76b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:57.095054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:57.095739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.096027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.096310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.097057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:57.097374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:57.098780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:57.101839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:57.102639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.102927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.103205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.115185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 348/710] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 2 13:32:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:57.116425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:57.117898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:57.125816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:32:57.134526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:57.135466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:57.136396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 363/711] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:57.145792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:57.245308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:57.252290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:57.260292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2e98b-e51c-4bbd-836e-cee7153ae380 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:57.303558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cdbcc-b037-4d3c-8043-dcfd2dc16d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:57.304742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdbcc-b037-4d3c-8043-dcfd2dc16d79 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.305296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdbcc-b037-4d3c-8043-dcfd2dc16d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.305844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cdbcc-b037-4d3c-8043-dcfd2dc16d79 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.306819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdbcc-b037-4d3c-8043-dcfd2dc16d79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:57.308020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdbcc-b037-4d3c-8043-dcfd2dc16d79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:57.309731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cdbcc-b037-4d3c-8043-dcfd2dc16d79 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:57.323391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 349/712] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 2 13:32:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:57.332939 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f756a-c268-47c3-be33-c4980bf1d53b None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.333590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f756a-c268-47c3-be33-c4980bf1d53b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.334088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f756a-c268-47c3-be33-c4980bf1d53b None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.335768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 350/713] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:57.348144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe90a1-3e5b-4708-b237-e882ef515bb0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.348834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe90a1-3e5b-4708-b237-e882ef515bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.349382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe90a1-3e5b-4708-b237-e882ef515bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.392070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6abe90a1-3e5b-4708-b237-e882ef515bb0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:57.393360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6abe90a1-3e5b-4708-b237-e882ef515bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:57.399604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5dce2-1409-4d41-82bd-c60e6c69a271 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:57.466809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:57.468956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.469513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.470000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.471041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:57.471571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:57.473987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:57.507481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 364/714] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:32:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:57.511215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:57.542443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 351/715] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 02 13:32:57.567310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe90a1-3e5b-4708-b237-e882ef515bb0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:57.628709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:57.637939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98153a-6320-4f0f-a42a-5530e4426ab9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:57.660984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:57.682019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe90a1-3e5b-4708-b237-e882ef515bb0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:57.705476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:57.706584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.706870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.707148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.707994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b73296e3c73644f29eb0b4960a747c38) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:57.708316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:57.710612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:57.720377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 365/716] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:32:57 2022] GET /identity/v3/role_assignments?user.id=b73296e3c73644f29eb0b4960a747c38&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:32:57.743350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:57.744177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.744490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.744774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] PATH_INFO: `/v3/services/network` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.745444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:57.746870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:57.765492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:57.766929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:32:57.768186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 352/717] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:32:57 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:32:57.776566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:57.939556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94cda3-b036-47ac-918a-45e3b9fecb0a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:57.977257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e7e39-efab-4bad-a48f-92be258a90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:57.977932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7e39-efab-4bad-a48f-92be258a90eb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:57.978219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7e39-efab-4bad-a48f-92be258a90eb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:57.978500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e7e39-efab-4bad-a48f-92be258a90eb None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:57.979208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e7e39-efab-4bad-a48f-92be258a90eb None admin] RBAC: Adding query filter params (name=network) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:57.979787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e7e39-efab-4bad-a48f-92be258a90eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:57.981175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e7e39-efab-4bad-a48f-92be258a90eb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:57.986654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 366/718] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:32:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:57.992187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:58.153422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa32590-4878-4d9b-87eb-94b1654ab64b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:58.205313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1836dfb6-fcb5-449d-b0c7-a825429d588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:58.206291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836dfb6-fcb5-449d-b0c7-a825429d588a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:58.206790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836dfb6-fcb5-449d-b0c7-a825429d588a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:58.207254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1836dfb6-fcb5-449d-b0c7-a825429d588a None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:58.208176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836dfb6-fcb5-449d-b0c7-a825429d588a None admin] RBAC: Adding query filter params (type=network) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:58.208732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836dfb6-fcb5-449d-b0c7-a825429d588a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:58.210310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1836dfb6-fcb5-449d-b0c7-a825429d588a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:58.220536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 353/719] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:32:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:59.108197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d82f-94f3-4bb0-9891-2321e69ef1ff None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:59.108837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d82f-94f3-4bb0-9891-2321e69ef1ff None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:59.108978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8d82f-94f3-4bb0-9891-2321e69ef1ff None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:59.110835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 367/720] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:32:59.115893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b68fb-75ce-4ec0-b92f-b4fb4afa3dc3 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:59.116310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b68fb-75ce-4ec0-b92f-b4fb4afa3dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:59.116524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b68fb-75ce-4ec0-b92f-b4fb4afa3dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:59.142359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a96b68fb-75ce-4ec0-b92f-b4fb4afa3dc3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:59.143610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a96b68fb-75ce-4ec0-b92f-b4fb4afa3dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:59.147079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:59.318218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 354/721] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:59.353546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d82f-94f3-4bb0-9891-2321e69ef1ff None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:59.392832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:59.500730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8d82f-94f3-4bb0-9891-2321e69ef1ff None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:59.551911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cfea83-7b32-4617-9c49-c8d950fe50c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:59.552740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfea83-7b32-4617-9c49-c8d950fe50c5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:59.553034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfea83-7b32-4617-9c49-c8d950fe50c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:59.553317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfea83-7b32-4617-9c49-c8d950fe50c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:59.569714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cfea83-7b32-4617-9c49-c8d950fe50c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-a1cfea83-7b32-4617-9c49-c8d950fe50c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:32:59.577481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:32:59.578411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:32:59.579724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 368/722] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:32:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:32:59.587036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b68fb-75ce-4ec0-b92f-b4fb4afa3dc3 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:59.609982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50932b-706c-4d26-aedd-586f17b1a9f9 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:59.610316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50932b-706c-4d26-aedd-586f17b1a9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:59.610740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50932b-706c-4d26-aedd-586f17b1a9f9 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:59.612426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 369/723] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:32:59.621731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6fc3-6538-46ab-967a-836ba5160ee7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:59.622017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6fc3-6538-46ab-967a-836ba5160ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:59.622304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94a6fc3-6538-46ab-967a-836ba5160ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:59.644980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d94a6fc3-6538-46ab-967a-836ba5160ee7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:32:59.646113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d94a6fc3-6538-46ab-967a-836ba5160ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:32:59.783608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 370/724] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:32:59.807205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6fc3-6538-46ab-967a-836ba5160ee7 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:59.815267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b68fb-75ce-4ec0-b92f-b4fb4afa3dc3 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:59.837813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:59.873002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:59.873958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:59.875202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:59.875774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:59.876578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:32:59.876895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:32:59.878289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:32:59.887926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 355/725] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:32:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:32:59.897512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:32:59.900264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:32:59.940920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94a6fc3-6538-46ab-967a-836ba5160ee7 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:32:59.976214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:32:59.977040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:32:59.977351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:32:59.977631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:32:59.997112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:00.009139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:00.010192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:33:00.011034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:00.018423 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 371/726] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:32:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:00.023675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:00.111695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f424a1-c3e4-4ac3-adf2-84277141c94a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.161932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627f458-6669-45ae-924e-c20d41329eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:00.163710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f458-6669-45ae-924e-c20d41329eae None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.164497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f458-6669-45ae-924e-c20d41329eae None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.164949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627f458-6669-45ae-924e-c20d41329eae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.183148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627f458-6669-45ae-924e-c20d41329eae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:00.189652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627f458-6669-45ae-924e-c20d41329eae None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:00.189831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-7627f458-6669-45ae-924e-c20d41329eae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:00.213563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:00.214714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:00.215860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:00.215860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:00.215860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:00.215860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:00.218587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 356/727] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:00.220356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d6e67-ab44-481a-909e-c3e6eea4fea0 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.220775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d6e67-ab44-481a-909e-c3e6eea4fea0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.221176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d6e67-ab44-481a-909e-c3e6eea4fea0 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.221673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51759f-bf31-494e-94c6-46ba069cf184 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.228596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 357/728] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:00.230199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d6e67-ab44-481a-909e-c3e6eea4fea0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:00.267997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860a1c3-f7ed-4f7f-b348-2258405cc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:00.269256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a1c3-f7ed-4f7f-b348-2258405cc47c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.269711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a1c3-f7ed-4f7f-b348-2258405cc47c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.270389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860a1c3-f7ed-4f7f-b348-2258405cc47c None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.271721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a1c3-f7ed-4f7f-b348-2258405cc47c None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:00.272438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a1c3-f7ed-4f7f-b348-2258405cc47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:00.273992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860a1c3-f7ed-4f7f-b348-2258405cc47c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:00.285314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 372/729] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:33:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:00.287608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605255b-ee1e-479d-93a2-35c2258f70e9 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.288052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605255b-ee1e-479d-93a2-35c2258f70e9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.288505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605255b-ee1e-479d-93a2-35c2258f70e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.300424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.312244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5605255b-ee1e-479d-93a2-35c2258f70e9 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:00.314246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5605255b-ee1e-479d-93a2-35c2258f70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:00.359081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d6e67-ab44-481a-909e-c3e6eea4fea0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.394808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 373/730] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:33:00.395976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605255b-ee1e-479d-93a2-35c2258f70e9 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:00.404514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:00.406131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.406131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.406492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.407228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:00.407537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:00.409462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:00.427037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 358/731] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:00.431821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:00.489995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.525249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605255b-ee1e-479d-93a2-35c2258f70e9 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.562971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2834f6d-970d-4680-8e2e-ff7ddd78f8da None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.567004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:00.567801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.568097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.568380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.579411 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.579987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:00.581498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:00.600368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95497897-4014-4e2d-801a-a5d5425c7236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:00.601275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95497897-4014-4e2d-801a-a5d5425c7236 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.601564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95497897-4014-4e2d-801a-a5d5425c7236 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.601845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95497897-4014-4e2d-801a-a5d5425c7236 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:00.602966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:00.603837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:00.605018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:00.605018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:00.605018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:00.605018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:00.605018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 374/732] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:00.605729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:00.613081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95497897-4014-4e2d-801a-a5d5425c7236 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:00.614708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95497897-4014-4e2d-801a-a5d5425c7236 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-95497897-4014-4e2d-801a-a5d5425c7236 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:00.636150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:00.637168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 359/733] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0000-2ee6-4845-a056-4d670774a55c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.643294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0000-2ee6-4845-a056-4d670774a55c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.644083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fb0000-2ee6-4845-a056-4d670774a55c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.644083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 360/734] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:00.644083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb0000-2ee6-4845-a056-4d670774a55c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:00.726216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380284cc-5ff8-4c84-a8b7-1ae17803d903 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.747989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.760636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fb0000-2ee6-4845-a056-4d670774a55c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.763053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0fc28-af9a-41b4-a88f-0be0c87fb350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:00.763726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0fc28-af9a-41b4-a88f-0be0c87fb350 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.764016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0fc28-af9a-41b4-a88f-0be0c87fb350 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.764301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0fc28-af9a-41b4-a88f-0be0c87fb350 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.765132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0fc28-af9a-41b4-a88f-0be0c87fb350 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:00.766466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af0fc28-af9a-41b4-a88f-0be0c87fb350 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:00.796085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:00.797788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.798072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.798352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.799099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:00.799406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:00.800815 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:00.812711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 361/735] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:00.813507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:00.849229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:00.863211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 375/736] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:00 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:00.864614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977def5-b3ef-40bf-8be5-c925782d0f17 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:00.864917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977def5-b3ef-40bf-8be5-c925782d0f17 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:00.865320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977def5-b3ef-40bf-8be5-c925782d0f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:00.887575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c977def5-b3ef-40bf-8be5-c925782d0f17 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:00.889596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c977def5-b3ef-40bf-8be5-c925782d0f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:00.948442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17058-1824-494c-a867-26867dfd4d12 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:00.992287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 376/737] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:00 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:33:00.992287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977def5-b3ef-40bf-8be5-c925782d0f17 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.010594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.011425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.011816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.012196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.013213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:01.013636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:01.015289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:01.039495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 362/738] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 2 13:33:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:01.045053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.122767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977def5-b3ef-40bf-8be5-c925782d0f17 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:01.130599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.146076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.154925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0f877-2d14-4c0f-a540-e1e32e73af15 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:01.159260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dc3257-3afe-4ab7-9eec-a92f7748311a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.160081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3257-3afe-4ab7-9eec-a92f7748311a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.160370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3257-3afe-4ab7-9eec-a92f7748311a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.160717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dc3257-3afe-4ab7-9eec-a92f7748311a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.167937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3257-3afe-4ab7-9eec-a92f7748311a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:01.169446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dc3257-3afe-4ab7-9eec-a92f7748311a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e4dc3257-3afe-4ab7-9eec-a92f7748311a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:01.189828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:01.191503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:01.192722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:01.195911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.196806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.197037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 377/739] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:33:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:01.197275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.197613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.198286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60a98-d224-4e27-9267-60c42f15cb3b None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.198587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60a98-d224-4e27-9267-60c42f15cb3b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.198879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d60a98-d224-4e27-9267-60c42f15cb3b None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.204824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 378/740] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:01.204824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d60a98-d224-4e27-9267-60c42f15cb3b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.214035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:01.222354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:01.225870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 363/741] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:01.226743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.312704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d60a98-d224-4e27-9267-60c42f15cb3b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:01.340376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a33a8-f8b1-41e0-879c-fad4d832fdfd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:01.348246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.349007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.349359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.349704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.377968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2acd29a-d8f8-43b7-8cdc-bf7bacb62afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.378640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd29a-d8f8-43b7-8cdc-bf7bacb62afc None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.378926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd29a-d8f8-43b7-8cdc-bf7bacb62afc None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.379204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2acd29a-d8f8-43b7-8cdc-bf7bacb62afc None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.380096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd29a-d8f8-43b7-8cdc-bf7bacb62afc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:01.380456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd29a-d8f8-43b7-8cdc-bf7bacb62afc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:01.381914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2acd29a-d8f8-43b7-8cdc-bf7bacb62afc None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:01.386816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.407583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 364/742] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 2 13:33:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:01.407583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9e27b-bb0e-4976-911a-7381e1f7970f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.407583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9e27b-bb0e-4976-911a-7381e1f7970f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.407583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9e27b-bb0e-4976-911a-7381e1f7970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.421986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-73d9e27b-bb0e-4976-911a-7381e1f7970f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:01.423404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-73d9e27b-bb0e-4976-911a-7381e1f7970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:01.427262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.429434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:01.431153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:01.496378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 365/743] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 02 13:33:01.501958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9e27b-bb0e-4976-911a-7381e1f7970f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.553091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 379/744] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:01.553952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.631090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9e27b-bb0e-4976-911a-7381e1f7970f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:01.636749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.667092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.667756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.668040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.668320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.669092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:01.669397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:01.670762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:01.672163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf356d-64c5-4953-8d63-14247b5bb90b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:01.680373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 366/745] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:01.681187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.683852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.715454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.716106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.716395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.716734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.788623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:01.790086 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:01.790633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5aed70-6a97-414e-9524-66e27d1d5c7a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:01.830542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:01.831308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:01.831625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:01.832005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:01.832798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:01.834313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:01.855100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:01.902625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 380/746] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 02 13:33:01.903972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:01.930351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 367/747] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:01 2022] POST /identity/v3/services => generated 240 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:01.931493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.020252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.034776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbff85-6099-4353-9b10-4c2740cc050d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.081219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.081991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.082276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.082558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.084042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c799a5-19fb-4565-bd46-417a42ea6b2b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.096370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.097921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:02.118914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:02.119866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:02.121157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:02.121157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:02.121157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:02.121157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:02.124643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 381/748] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:02.126582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.131232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.133840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.134366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.134993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.148195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.152432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.157405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:02.184343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:02.185336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:02.186234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:02.186234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:02.186234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:02.186234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:02.186466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 368/749] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:02.189437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.268528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196111ae-4564-4f02-8487-abb7456fc85f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.305129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.305924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.306213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.306601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.317100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.318569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.320723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2a6f8-ced3-487b-90e5-09ad6e780ad0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.333447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:02.337636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:02.338682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:02.339803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:02.339803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:02.339803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:02.339803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:02.340980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 382/750] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:02.341726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.367969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.369105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.369474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.370211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.371276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:02.371661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.375149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.390363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 369/751] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:02.391434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.420330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.457697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657bdfd-df51-49d6-a939-22a24ee26702 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.510124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.510806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.511096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.511378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.512110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:02.512442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.513829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.528443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 383/752] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:02.528443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.538605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616784f9-198a-4f7f-a597-94bd1f7c5415 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.575466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.576384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.576843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.577846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.578955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:02.579474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.581102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.594158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 370/753] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:02.595328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.630998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.649911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e5daf-d00c-419b-aff7-15ea8f71007c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.683875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.695215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.696252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.696889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.697233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.707082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.709229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.712392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629e576-07aa-4b9a-af91-1b89b9d0be0f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:02.727536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:02.728573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:02.729721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:02.736182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 384/754] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:02.736182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.760187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.761016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.761305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.761588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.769840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.771305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:02.786486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:02.787498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:02.788441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:02.792386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 371/755] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:02.793332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.868023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892f222-e539-4f06-8f25-3144d10497e7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.908936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.910051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.910268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.910446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.914814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:02.919514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.921906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.928204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168f8c0-24ef-485e-9533-825cf7307d69 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:02.936332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:02.938001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:02.938896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:02.942890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 385/756] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:02.943757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:02.974849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:02.976396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:02.976882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:02.977595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:02.978804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:02.979977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:02.981965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:02.996802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:03.008748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 372/757] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:03.010474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.068702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d9c03-b25c-4e27-84a0-446b203d8e51 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:03.106094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:03.106768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.107168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.107458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.108452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:03.108781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:03.110472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:03.130344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aabde3-616b-44c6-9913-c85210da587a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:03.135222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 386/758] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:33:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:03.136176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.178334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:03.179130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.179474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.179818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.180693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:03.181580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:03.183544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:03.200629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 373/759] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:03.201502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.217246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:03.259656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f63e8d-5bf8-4219-bdfb-4b590086885d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:03.263033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:03.299670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:03.300714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.301005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.301281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.302434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=4599a196029c4f73b8428250cc19f8d3) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:03.302911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:03.304433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:03.310730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 387/760] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/role_assignments?user.id=4599a196029c4f73b8428250cc19f8d3&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:03.311603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.330698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fc446-034d-49fd-8279-c8e8c6fdaae4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:03.383963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fcf16-fba7-45ab-932f-9d3afe3dd594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:03.385139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fcf16-fba7-45ab-932f-9d3afe3dd594 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.385427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fcf16-fba7-45ab-932f-9d3afe3dd594 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.385705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fcf16-fba7-45ab-932f-9d3afe3dd594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.399231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fcf16-fba7-45ab-932f-9d3afe3dd594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:03.400797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fcf16-fba7-45ab-932f-9d3afe3dd594 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-d38fcf16-fba7-45ab-932f-9d3afe3dd594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:03.426634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:03.427652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:03.428624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:03.428624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:03.428624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:03.428624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:03.437389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 374/761] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:03.437389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89e731-93a0-4106-a9fc-12b2eff56551 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.437389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89e731-93a0-4106-a9fc-12b2eff56551 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.437389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89e731-93a0-4106-a9fc-12b2eff56551 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.437389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 375/762] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:03.441878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89e731-93a0-4106-a9fc-12b2eff56551 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.458068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbe08e-ccc2-4d4d-9896-47022388386d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:03.512330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f5763-5756-42f4-89ef-e3e608fe6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:03.513010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:03.515110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f5763-5756-42f4-89ef-e3e608fe6324 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.515790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f5763-5756-42f4-89ef-e3e608fe6324 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.516495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f5763-5756-42f4-89ef-e3e608fe6324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.518106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f5763-5756-42f4-89ef-e3e608fe6324 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=6d3513ec025a448cad13fead94966aac) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:03.518907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f5763-5756-42f4-89ef-e3e608fe6324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:03.520917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314f5763-5756-42f4-89ef-e3e608fe6324 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:03.528017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 388/763] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/role_assignments?user.id=6d3513ec025a448cad13fead94966aac&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:03.531400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16137503-7fc9-4a2d-943f-222e268c7b45 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.531400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16137503-7fc9-4a2d-943f-222e268c7b45 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.531400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16137503-7fc9-4a2d-943f-222e268c7b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.548508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-16137503-7fc9-4a2d-943f-222e268c7b45 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:03.549770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-16137503-7fc9-4a2d-943f-222e268c7b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:03.571066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89e731-93a0-4106-a9fc-12b2eff56551 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:03.589988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:03.633552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:03.634240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.634527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.634805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.635567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:03.635870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:03.637671 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:03.663188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 376/764] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:03.671902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.681600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 389/765] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:03.713750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16137503-7fc9-4a2d-943f-222e268c7b45 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.789412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cd22d-2129-4328-98be-5ece06e7e227 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:03.816757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:03.829264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:03.837167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:03.837167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:03.837167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:03.838241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:03.839710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:03.855266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:03.856230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:03.857159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 377/766] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:03.864673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:03.971961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16137503-7fc9-4a2d-943f-222e268c7b45 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.013242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.014055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.014334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.014639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.016938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.024426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:04.035113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:04.036072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:04.036929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 390/767] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:04.048434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:04.078552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:04.109127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141a3ce-e0ac-48e7-93f3-d3323fbf9222 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.166607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff69806-9306-4117-ba6f-07ed5f6126de None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.202912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.203810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.204101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.204393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.205254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:04.205806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.207832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.216476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.217177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.217466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.217773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.219046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:04.219361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.221515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.228363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 391/768] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 2 13:33:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:04.236219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:04.244629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 378/769] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:04.251777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:04.329244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:04.402603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0031953-5dc5-473c-9a21-f4170d98fa83 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.404814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:04.416722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7e2fb-3938-4ff6-be06-0c1a917efae1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.473742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.474412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.474700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.474985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.475695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:04.476004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.477723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.479962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.480856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.481149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.481458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b73296e3c73644f29eb0b4960a747c38/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.485881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=b73296e3c73644f29eb0b4960a747c38, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.487408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.491712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 392/770] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 2 13:33:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:04.497714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:04.602944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 379/771] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:33:04 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b73296e3c73644f29eb0b4960a747c38/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:33:04.617920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8703c9-8be4-488f-a2ee-5018c9fa689e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.667572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b2219-44e2-404c-998e-d89a1b49a8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.668719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2219-44e2-404c-998e-d89a1b49a8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.669259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2219-44e2-404c-998e-d89a1b49a8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.669764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b2219-44e2-404c-998e-d89a1b49a8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.670795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b2219-44e2-404c-998e-d89a1b49a8b3 None admin] RBAC: Adding query filter params (interface=public, service_id=46ead08dba1f440697e6fdf0e2aec6e4, region_id=RegionOne) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:04.672070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b2219-44e2-404c-998e-d89a1b49a8b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.673925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b2219-44e2-404c-998e-d89a1b49a8b3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.688905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 393/772] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:33:04 2022] GET /identity/v3/endpoints?service_id=46ead08dba1f440697e6fdf0e2aec6e4&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:04.694909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:04.711072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c257bfc-217f-41b9-9ba7-93eb40dcb332 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.711819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c257bfc-217f-41b9-9ba7-93eb40dcb332 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.712327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c257bfc-217f-41b9-9ba7-93eb40dcb332 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.714431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 394/773] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:04.722927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dfe52-dc78-4c76-8f79-bc41cb997021 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.723581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dfe52-dc78-4c76-8f79-bc41cb997021 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.724068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dfe52-dc78-4c76-8f79-bc41cb997021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.746306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d28dfe52-dc78-4c76-8f79-bc41cb997021 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:04.747441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d28dfe52-dc78-4c76-8f79-bc41cb997021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:04.762585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:04.840499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b809108-b6dc-47c8-b947-c4ca6c88353e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:04.842615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:04.860454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 395/774] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:04.889197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dfe52-dc78-4c76-8f79-bc41cb997021 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:04.902100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:04.903048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:04.903486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:04.903917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:04.904821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:04.906730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:04.913052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 380/775] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:04 2022] GET /identity/v3/services => generated 772 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:05.011193 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dfe52-dc78-4c76-8f79-bc41cb997021 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:05.049849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:05.050899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:05.051360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:05.051810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:05.052650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:05.054190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:05.067424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:05.068741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:33:05.069782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:05.072263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 396/776] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:04 2022] GET /identity/v3/services/network => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:05.081530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:05.231087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9ba9-f9e9-4640-85aa-defa66322598 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:05.272226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:05.273213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:05.273668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:05.274110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:05.274980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] RBAC: Adding query filter params (name=network) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:05.275457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:05.277028 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:05.282297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 381/777] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:05.288532 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:05.304854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:05.398917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355598e5-c671-49bf-9629-6ee4f9dd3cf2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:05.446055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:05.446728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:05.447003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:05.447287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:05.448000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:05.448313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:05.449718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:05.460639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 397/778] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:05.466550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:05.506439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:05.584669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b77b8f3-461d-440c-921a-deceb662d77d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:05.620753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673bb9f-0d2a-4ca5-9ff2-a4827a075031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:05.621428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673bb9f-0d2a-4ca5-9ff2-a4827a075031 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:05.621722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673bb9f-0d2a-4ca5-9ff2-a4827a075031 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:05.622006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673bb9f-0d2a-4ca5-9ff2-a4827a075031 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:05.622812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673bb9f-0d2a-4ca5-9ff2-a4827a075031 None admin] RBAC: Adding query filter params (interface=public, service_id=61df840feed048bea3f101e7ea9b0add, region_id=RegionOne) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:05.623129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673bb9f-0d2a-4ca5-9ff2-a4827a075031 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:05.625363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673bb9f-0d2a-4ca5-9ff2-a4827a075031 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:05.633718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 382/779] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:33:05 2022] GET /identity/v3/endpoints?service_id=61df840feed048bea3f101e7ea9b0add&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:05.641602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:05.776731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:05.800816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a2fa4-a4bb-4aa2-a7af-e730b8fd5ce3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:05.836696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f564800-f7c1-4834-a853-6867f105698d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:05.837291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f564800-f7c1-4834-a853-6867f105698d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:05.837577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f564800-f7c1-4834-a853-6867f105698d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:05.837865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f564800-f7c1-4834-a853-6867f105698d None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:05.838554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f564800-f7c1-4834-a853-6867f105698d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:05.839942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f564800-f7c1-4834-a853-6867f105698d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:05.850591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 398/780] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:05 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:06.053072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2599-11fa-490c-88c9-632204b6e849 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.053459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2599-11fa-490c-88c9-632204b6e849 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.053652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787f2599-11fa-490c-88c9-632204b6e849 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.055161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 383/781] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:06.063900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ce7fd-cd72-4c8c-a7ca-f0a5e46099b7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.063900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ce7fd-cd72-4c8c-a7ca-f0a5e46099b7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.063900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ce7fd-cd72-4c8c-a7ca-f0a5e46099b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.081111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1d4ce7fd-cd72-4c8c-a7ca-f0a5e46099b7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:06.082684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1d4ce7fd-cd72-4c8c-a7ca-f0a5e46099b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:06.160823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 399/782] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:06.181867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2599-11fa-490c-88c9-632204b6e849 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:06.235184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ed1a-17b1-49e8-a156-b637960e2dae None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.235862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ed1a-17b1-49e8-a156-b637960e2dae None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.236365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01ed1a-17b1-49e8-a156-b637960e2dae None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.239097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 400/783] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:06.245561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafa52f-b996-4485-b099-fc246aaa8151 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.246187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafa52f-b996-4485-b099-fc246aaa8151 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.246701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dafa52f-b996-4485-b099-fc246aaa8151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.266076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7dafa52f-b996-4485-b099-fc246aaa8151 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:06.267654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7dafa52f-b996-4485-b099-fc246aaa8151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:06.303877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:06.314441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787f2599-11fa-490c-88c9-632204b6e849 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:06.358519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:06.359747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.360038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.360319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.372567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:06.381546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:06.382567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:33:06.383500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:06.387821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 384/784] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:33:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:06.390244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:06.397733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:06.409108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 401/785] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:06.444219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafa52f-b996-4485-b099-fc246aaa8151 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:06.541692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435d76-31ec-4fd2-832b-8a9d53905eb8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:06.593837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dafa52f-b996-4485-b099-fc246aaa8151 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:06.630873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:06.631668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.632032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.632331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.638385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:06.639315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.640494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.640993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.641977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:06.642505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:06.643853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:06.644333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:06.651525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:06.652548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:06.653402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:06.660242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 402/786] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:06.661048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:06.667863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 385/787] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:33:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:06.673735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:06.696822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:06.750924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:06.830945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af810a8d-a26a-4623-89c4-3ee59fd82ce3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:06.869454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a411ca6-2b0e-4045-8d81-7a0d5198cdae None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:06.892268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:06.892979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.893263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.893648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.894514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:06.894832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:06.896223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:06.910472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 403/788] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:06.911957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:06.941158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:06.941973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:06.942438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:06.942730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:06.961578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:06.963001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:06.993620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:06.994614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:06.995539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:06.995539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:06.995539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:06.995539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:06.995539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 386/789] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:07.001135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.053353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea72e0-f997-4ee4-a1e6-0236a1710c10 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:07.106077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:07.107793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:07.140434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:07.141292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.141591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.141872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.159497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55dfb42-99b9-4551-95d8-14fb481e19f8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:07.162485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:07.163968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:07.200442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:07.202615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:07.203537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:07.203537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:07.203537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:07.203537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:07.203537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 404/790] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:07.207459 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.293235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:07.293844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.294133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.294414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.295156 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:07.295492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:07.297240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:07.325200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d8482-3dd6-4dd8-ae40-b72f4765501c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:07.330434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 387/791] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:07.341437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.368819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:07.369489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.370206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.370496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.371228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:07.371542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:07.373021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:07.387793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 405/792] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:07.393826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.444906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:07.513744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9fc80-73e8-45a1-898d-13cd1b2717fa None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:07.557996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:07.559124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.559606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.560043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.569266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:07.571046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:07.578007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f098ba0-021d-44ba-b56e-9148dca7ccf3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:07.588547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:07.589753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:33:07.590837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:07.597548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 406/793] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:07.600267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.629801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:07.638562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5069b-431e-4c7d-a8a7-1a30787d747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:07.644797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5069b-431e-4c7d-a8a7-1a30787d747e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.644797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5069b-431e-4c7d-a8a7-1a30787d747e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.644797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5069b-431e-4c7d-a8a7-1a30787d747e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.648360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5069b-431e-4c7d-a8a7-1a30787d747e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:07.649974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5069b-431e-4c7d-a8a7-1a30787d747e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-21a5069b-431e-4c7d-a8a7-1a30787d747e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:07.668141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:07.669180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:07.670139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 388/794] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:07.671924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06ef4-e4ad-4775-84fb-df89bcea153c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.671924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06ef4-e4ad-4775-84fb-df89bcea153c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.671924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c06ef4-e4ad-4775-84fb-df89bcea153c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.678170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 389/795] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:07.678170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06ef4-e4ad-4775-84fb-df89bcea153c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.721809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:07.733723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd57536-e3f3-4df4-b1ae-1014c6c7ca38 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:07.777656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c8a55-f741-43c7-983b-b29688cf8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:07.778613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c8a55-f741-43c7-983b-b29688cf8a35 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.779120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c8a55-f741-43c7-983b-b29688cf8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.779551 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c8a55-f741-43c7-983b-b29688cf8a35 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.780874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c8a55-f741-43c7-983b-b29688cf8a35 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:07.781340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c8a55-f741-43c7-983b-b29688cf8a35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:07.783886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c8a55-f741-43c7-983b-b29688cf8a35 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:07.804834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 407/796] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:07.806256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adaec8-8297-4127-b2a0-04fbff5c1ba6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.806649 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adaec8-8297-4127-b2a0-04fbff5c1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.807030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98adaec8-8297-4127-b2a0-04fbff5c1ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.824029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c06ef4-e4ad-4775-84fb-df89bcea153c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:07.825107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-98adaec8-8297-4127-b2a0-04fbff5c1ba6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:07.826421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-98adaec8-8297-4127-b2a0-04fbff5c1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:07.863168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:07.864128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.864619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.865108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.866151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:07.866736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:07.868397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:07.888888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 390/797] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:07.890014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.909230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 408/798] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:07.909230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1026fa-4166-4420-af7b-be43e4e7eabd None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:07.909230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1026fa-4166-4420-af7b-be43e4e7eabd None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:07.909230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1026fa-4166-4420-af7b-be43e4e7eabd None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:07.909230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 409/799] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:07.909230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1026fa-4166-4420-af7b-be43e4e7eabd None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:07.947563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.002401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.007539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be15bbb-403b-4027-bea2-4b7b40772fc9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.022441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1026fa-4166-4420-af7b-be43e4e7eabd None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.043415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102c8e4-8ac3-4341-ac1c-0f804e1e0bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.044205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c8e4-8ac3-4341-ac1c-0f804e1e0bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.044522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c8e4-8ac3-4341-ac1c-0f804e1e0bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.044804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102c8e4-8ac3-4341-ac1c-0f804e1e0bf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.055755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102c8e4-8ac3-4341-ac1c-0f804e1e0bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.057265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102c8e4-8ac3-4341-ac1c-0f804e1e0bf0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.063271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.064310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.064949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.065233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.075881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-2102c8e4-8ac3-4341-ac1c-0f804e1e0bf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:08.076019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:08.076880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:08.078424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:08.078424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:08.078424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:08.078424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:08.078648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.081899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 391/800] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:08.083186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b818e-ea13-4326-ab63-5f3e81eccaa2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.083479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b818e-ea13-4326-ab63-5f3e81eccaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.083783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b818e-ea13-4326-ab63-5f3e81eccaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:08.098348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:08.099271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:08.100163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:08.100163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:08.100163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:08.100163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:08.100163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 410/801] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:08.100915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.106300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-fe7b818e-ea13-4326-ab63-5f3e81eccaa2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:08.107500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-fe7b818e-ea13-4326-ab63-5f3e81eccaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:08.181401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 392/802] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:08.182599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b818e-ea13-4326-ab63-5f3e81eccaa2 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.213679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6e2a6-9dd7-401d-bcab-7fef9e485a94 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.225168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.251533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.252331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.252648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.252930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.254831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.264256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:08.276730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:08.277917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 411/803] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:08.278769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.316306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b818e-ea13-4326-ab63-5f3e81eccaa2 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.353453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.354316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.354606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.354891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.355634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:08.355946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.357418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.370978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 393/804] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:08.372001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.401885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcdb73-d62f-428b-93b0-4073006050e6 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.444184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.444974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.445335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.445684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.446475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:08.447550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.448319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.462065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 412/805] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:08.462837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.478533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.490627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d75170-73dd-4354-88ae-1db1c2eb8069 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.530601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.530931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.531416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.531770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.532050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.532727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.534102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:08.546860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:08.547888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:08.554061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 394/806] 10.222.0.33 () {56 vars in 1129 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:08.555122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.589950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a545d8c-dac5-4006-a6be-0129368e33ea None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.628003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.628668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.628919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.629198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.629943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:08.630253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.631618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.641827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 413/807] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:08.642482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.669634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429acbc-b7a4-46a3-bf41-73e63b23cb53 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.705531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.706318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.706603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.706882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.713406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.714893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:08.730089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:08.731174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 395/808] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:08.732337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.746696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.752161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0340c8-2803-4abd-975d-081c9a684670 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.767844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.784870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.785660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.785949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.786214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.792643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.797155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:08.808319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:08.809511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 414/809] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:08.810612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.833239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c16d-d8fb-48c3-ae17-8b54517b969d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.867022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d861b1-2c80-4db9-88cb-95be0a1ee20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.867687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d861b1-2c80-4db9-88cb-95be0a1ee20b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.867970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d861b1-2c80-4db9-88cb-95be0a1ee20b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.868249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d861b1-2c80-4db9-88cb-95be0a1ee20b None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.868983 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d861b1-2c80-4db9-88cb-95be0a1ee20b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:08.869293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d861b1-2c80-4db9-88cb-95be0a1ee20b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.870689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d861b1-2c80-4db9-88cb-95be0a1ee20b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.875828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 396/810] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:08.877120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775f56-80af-47cb-b25b-980e9bd6fa5b None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.877406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775f56-80af-47cb-b25b-980e9bd6fa5b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.877672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a775f56-80af-47cb-b25b-980e9bd6fa5b None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.878991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 397/811] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:08.879620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775f56-80af-47cb-b25b-980e9bd6fa5b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:08.914781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a33f1-4c6f-42b5-8976-ad15fe56410b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.948886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:08.949671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:08.949956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:08.950236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:08.955980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:08.960471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:08.961945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:08.980331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a775f56-80af-47cb-b25b-980e9bd6fa5b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:08.981006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:08.986345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:08.987262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:08.987262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:08.987262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:08.987262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:08.987262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 415/812] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:08.987262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.011789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:09.020742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.023108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.023108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.023108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.023108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:09.023108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.024517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.036765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 398/813] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:09.037754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.083993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba81239-ab4f-4664-a3e4-7040a5142636 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.118528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1155f-1016-4d02-a2fa-eec29c4f3dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.119188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1155f-1016-4d02-a2fa-eec29c4f3dcf None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.119475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1155f-1016-4d02-a2fa-eec29c4f3dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.119754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1155f-1016-4d02-a2fa-eec29c4f3dcf None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.120571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1155f-1016-4d02-a2fa-eec29c4f3dcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:09.120884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1155f-1016-4d02-a2fa-eec29c4f3dcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.122327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1155f-1016-4d02-a2fa-eec29c4f3dcf None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.133882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 416/814] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:09.135080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aca1a-198b-4d7d-88b0-ccf0a68d029c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.135395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aca1a-198b-4d7d-88b0-ccf0a68d029c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.135655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7aca1a-198b-4d7d-88b0-ccf0a68d029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.144488 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1588af3-9082-4705-a3fb-ee0171e28d5d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.151672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-fa7aca1a-198b-4d7d-88b0-ccf0a68d029c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:09.152887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fa7aca1a-198b-4d7d-88b0-ccf0a68d029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:09.178856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.179562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.179871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.180203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.180942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:09.181249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.182634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.184598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:09.187768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 399/815] 10.222.0.33 () {56 vars in 1124 bytes} [Thu Jun 2 13:33:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:09.188576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.225726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 417/816] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:09.226548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aca1a-198b-4d7d-88b0-ccf0a68d029c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.244888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:09.291532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0e26a-aef6-4637-9892-f2e0e4e087a5 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.324275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7aca1a-198b-4d7d-88b0-ccf0a68d029c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.326144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.326818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.327639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.328091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.328836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:09.329145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.330506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.343573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 400/817] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:09.344313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.360280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.361290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.361581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.361866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/4599a196029c4f73b8428250cc19f8d3/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.363848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=4599a196029c4f73b8428250cc19f8d3, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.365318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.404098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:09.443965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 418/818] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:33:09 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/4599a196029c4f73b8428250cc19f8d3/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:33:09.444146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263db9da-e4e3-43e0-89ac-4c91d2b4c944 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.444801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.488121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.489163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.489450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.489775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/6d3513ec025a448cad13fead94966aac/roles/02b52b44bf4341fc9f58c196cadecfe9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.510516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=6d3513ec025a448cad13fead94966aac, role_id=02b52b44bf4341fc9f58c196cadecfe9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.512064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.549618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:09.571992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1cfb9-8cd3-42b2-a73c-04d81a7db2af None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.607172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.607855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.608136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.609427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.609874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.611365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.621593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 401/819] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:33:09 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/6d3513ec025a448cad13fead94966aac/roles/02b52b44bf4341fc9f58c196cadecfe9 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:33:09.622782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.736598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 419/820] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:09.738223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.756151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f26505-6e68-4d25-96a0-df1a6d25f566 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.769605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:09.806167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.807446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.807894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.808360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] PATH_INFO: `/v3/services/network` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.809319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.810944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:09.824899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:09.826305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 02 13:33:09.827217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:09.830316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 402/821] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:09 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:09.843652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:09.904359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2550ad2-f22a-4b26-acf7-0b88ee1eef86 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.943334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:09.944144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:09.944459 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:09.944745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:09.947347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:09.953832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:09.955311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:09.971134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:09.972164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:09.973148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 420/822] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:33:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:09.979695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4eae8-5443-4e38-9214-345730ad0aed None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:09.980604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:10.020138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:10.021210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:10.021682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:10.022123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:10.022998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] RBAC: Adding query filter params (name=network) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:10.023467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:10.025111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:10.032161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 403/823] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:10.052239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:10.103739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d747e33-8306-40b0-bc23-82ae6048a88e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:10.112271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:10.151304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:10.152458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:10.152762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:10.153313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:10.154169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:10.154544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:10.156889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:10.183252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 421/824] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:33:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:10.188706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:10.211646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e23788-fb46-47d2-93e3-ac3b28e428da None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:10.252646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:10.261149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:10.264923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:10.264923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:10.264923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:10.264923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:10.264923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:10.271045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:10.274687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 404/825] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:10.282345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:10.328570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13c21f-3926-459e-b5b6-628bf1b9e684 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:10.368141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:10.368843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:10.369133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:10.369710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:10.474450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2211742-14fe-4904-8c24-800ff3eae0f9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:10.477905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:10.495046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:10.498057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:10.547960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:10.549029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:10.549525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:10.550004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:10.550946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:10.553714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:10.591502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:10.646500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 422/826] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:33:10.651902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:10.662388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 405/827] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:10.767741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089461b-5f2d-49f5-93b6-8c5da0e616d1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:10.813692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:10.814948 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:10.815463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:10.815957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:10.829650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:10.831478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:10.841578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:10.852188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:10.853168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:10.854346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:10.854346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:10.854346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:10.854346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:10.854346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 423/828] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:10.859911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:11.008574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd214d8f-f653-4df4-a049-2856b53bf353 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:11.052327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:11.052327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:11.052327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:11.052327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:11.052994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:11.056112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:11.056489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:11.071181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 406/829] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:11.076481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:11.181726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5087e6-839a-4c5d-a5ba-53e977d8552e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:11.217262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:11.218797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:11.219078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:11.219406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:11.226619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:11.228074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:11.242521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:11.244626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:11.246849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 424/830] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:11.249983 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:11.277262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:11.376926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693eda90-4ecc-42e4-b76d-828436f529a8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:11.412310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c42d2-db08-4dd9-8bd6-c5e6d32d44a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:11.413019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c42d2-db08-4dd9-8bd6-c5e6d32d44a1 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:11.413303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c42d2-db08-4dd9-8bd6-c5e6d32d44a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:11.413577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c42d2-db08-4dd9-8bd6-c5e6d32d44a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:11.414362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c42d2-db08-4dd9-8bd6-c5e6d32d44a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:11.414703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c42d2-db08-4dd9-8bd6-c5e6d32d44a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:11.416142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c42d2-db08-4dd9-8bd6-c5e6d32d44a1 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:11.428522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 407/831] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:11.437876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:11.504790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:11.544012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816bbdf-4736-42f8-99b3-d7fa6050e8a5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:11.579458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bbe7d-670e-4145-959c-231816e873d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:11.580190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbe7d-670e-4145-959c-231816e873d4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:11.580531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbe7d-670e-4145-959c-231816e873d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:11.580811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bbe7d-670e-4145-959c-231816e873d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:11.581639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bbe7d-670e-4145-959c-231816e873d4 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b73296e3c73644f29eb0b4960a747c38) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:11.581949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bbe7d-670e-4145-959c-231816e873d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:11.583366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5bbe7d-670e-4145-959c-231816e873d4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:11.589817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 425/832] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:11 2022] GET /identity/v3/role_assignments?user.id=b73296e3c73644f29eb0b4960a747c38&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:12.090214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619a02-00a1-41e2-a940-e62de1bb61fc None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.090214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619a02-00a1-41e2-a940-e62de1bb61fc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.090214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7619a02-00a1-41e2-a940-e62de1bb61fc None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.090214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 408/833] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:12.099194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab8388-732c-4889-b4ce-023c23e74353 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.099194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab8388-732c-4889-b4ce-023c23e74353 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.099194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab8388-732c-4889-b4ce-023c23e74353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.115917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7aab8388-732c-4889-b4ce-023c23e74353 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:12.117448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7aab8388-732c-4889-b4ce-023c23e74353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:12.191258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 426/834] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:12.215196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7619a02-00a1-41e2-a940-e62de1bb61fc None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:12.297945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:12.328996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7619a02-00a1-41e2-a940-e62de1bb61fc None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:12.364509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8da267-bd62-449e-b68c-a4fdfceb6e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:12.365226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da267-bd62-449e-b68c-a4fdfceb6e08 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.365511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da267-bd62-449e-b68c-a4fdfceb6e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.365787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8da267-bd62-449e-b68c-a4fdfceb6e08 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.377157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8da267-bd62-449e-b68c-a4fdfceb6e08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-7b8da267-bd62-449e-b68c-a4fdfceb6e08 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:12.384824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:12.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:12.386665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 409/835] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:12.392015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab8388-732c-4889-b4ce-023c23e74353 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:12.394697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25a5c-b484-4ea2-a29b-c1ad9e1e9ac7 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.395895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25a5c-b484-4ea2-a29b-c1ad9e1e9ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.396202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25a5c-b484-4ea2-a29b-c1ad9e1e9ac7 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.398916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 410/836] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:12.407804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb124a-b714-433d-81ac-575cb64119b1 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.408111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb124a-b714-433d-81ac-575cb64119b1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.408397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb124a-b714-433d-81ac-575cb64119b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.431989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5acb124a-b714-433d-81ac-575cb64119b1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:12.433221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5acb124a-b714-433d-81ac-575cb64119b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:12.454057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:12.508890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab8388-732c-4889-b4ce-023c23e74353 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:12.528537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 411/837] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:12.531076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e7eb8-b796-41b9-aed5-28dc71e82169 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.531376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e7eb8-b796-41b9-aed5-28dc71e82169 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.531659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25e7eb8-b796-41b9-aed5-28dc71e82169 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.533035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 412/838] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:12.537968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306d8f-d1d5-4897-9f6a-7b8f6ab6bfec None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.538420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306d8f-d1d5-4897-9f6a-7b8f6ab6bfec None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.538879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306d8f-d1d5-4897-9f6a-7b8f6ab6bfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.555525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:12.556279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.556606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.556706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-51306d8f-d1d5-4897-9f6a-7b8f6ab6bfec None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:12.556895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.557626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:12.557893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-51306d8f-d1d5-4897-9f6a-7b8f6ab6bfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:12.557989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:12.559343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:12.568609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 427/839] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:12.573803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:12.623000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:12.640760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 413/840] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:12.641539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51306d8f-d1d5-4897-9f6a-7b8f6ab6bfec None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:12.684917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7f9a0a-419a-4145-9742-8836c5d58db4 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:12.701794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:12.722927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:12.723727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.724013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.724294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.736131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:12.744416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:12.745366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:12.746234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 428/841] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:33:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:12.746915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:12.768081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51306d8f-d1d5-4897-9f6a-7b8f6ab6bfec None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:12.804600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:12.805416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.805720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.805989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.817858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:12.819872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:12.839448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:12.840377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:12.841331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:12.841331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:12.841331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:12.841331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:12.841331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 414/842] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:12.841696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:12.869019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754394b-6490-43b1-a98b-8a37a4e57b67 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:12.892310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:12.910397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:12.911204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.911494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.911774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.912454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:12.913839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:12.927017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:12.928025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:12.928907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 429/843] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:12.929691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:12.956843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c752a6-4ef0-4ce2-ab59-bdbb98cde618 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:12.975527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:12.995627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:12.996301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:12.996620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:12.996908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:12.997657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:12.997972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.000232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.013496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 415/844] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:33:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:13.013496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.050302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c878ba-3c0c-40fc-8480-9eb66744fdab None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.086636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.087294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.087582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.087855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.088599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:13.088907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.090265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.106781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 430/845] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:13.106781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.134472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847e1c9-9879-4d98-94be-30bf9a7b4a4b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.143762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:13.168166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.168909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.169197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.169529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.170243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:13.171102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.172507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.181325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 416/846] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:13.181325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.212719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:13.216293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9ae24-85e6-476e-adb6-3bd561f0d2ef None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.253862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.254659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.254951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.255241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.266098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.267558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:13.285507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:13.286604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:13.292244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:13.292244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:13.292244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:13.292244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:13.292244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 431/847] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:13.292244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.302142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dadf8-0179-498e-9e18-8d1c507b2c22 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.338545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.339349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.339640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.340211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.348363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.349847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:13.365729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:13.366701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 02 13:33:13.367632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:13.369629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 417/848] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:13.370558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.408807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a062d-c897-4534-92fc-573e3785e4fe None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.413155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:13.450644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.451311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.451599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.452498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.453242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:13.453527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.454900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.464635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 432/849] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:13.464635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.506598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:13.511142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5f697-cdd7-4885-86df-de7f73ee16b9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.551758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.552685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.553091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.553447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.554273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:13.554661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.556266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.571436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 418/850] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:13.576630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.616619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add71fe7-8f3e-41fe-b95a-68686bd96cdd None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.664636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.665352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.665646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.665929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.666901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:13.667223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.668868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.681680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:13.691494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88030f-f868-445a-92ff-9469df131d17 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.693168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 433/851] 10.222.0.33 () {56 vars in 1135 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:13.699543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.741737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.743267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.743760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.744534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.757604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.760216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:13.781460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:13.782466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:13.783422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:13.786290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 419/852] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:13.791762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:13.812884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:13.831476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccfeaa-e713-4962-b22b-a0eda0e3a9ed None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.880124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338ed8f3-7d6f-4809-80e4-d867c9ac8242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.881191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed8f3-7d6f-4809-80e4-d867c9ac8242 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.881689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed8f3-7d6f-4809-80e4-d867c9ac8242 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.882177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed8f3-7d6f-4809-80e4-d867c9ac8242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.919328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb25197-c566-433e-9d24-013b82d9d807 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:13.961634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:13.963224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:13.963701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:13.964190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:13.965250 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:13.966020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.969175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.969687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ed8f3-7d6f-4809-80e4-d867c9ac8242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:13.971284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338ed8f3-7d6f-4809-80e4-d867c9ac8242 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:13.994492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 420/853] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:14.000471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.013762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.055135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.080781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 434/854] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:33:14.082227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262542b-c694-4a11-81dd-fcf14c8d2e37 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.082524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262542b-c694-4a11-81dd-fcf14c8d2e37 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.082790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262542b-c694-4a11-81dd-fcf14c8d2e37 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.084227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 435/855] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:14.086208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262542b-c694-4a11-81dd-fcf14c8d2e37 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.125457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe5471-82b7-45a9-9c05-c4d177d00b35 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.161283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.161945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.162208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.162489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.195486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262542b-c694-4a11-81dd-fcf14c8d2e37 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.233286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.233645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e983-3ed8-44ca-95e5-37434173c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.234457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e983-3ed8-44ca-95e5-37434173c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.234745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e983-3ed8-44ca-95e5-37434173c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.234999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.235111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e983-3ed8-44ca-95e5-37434173c0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.247023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.247407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e983-3ed8-44ca-95e5-37434173c0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.249469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e983-3ed8-44ca-95e5-37434173c0a4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-a0e3e983-3ed8-44ca-95e5-37434173c0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:14.267514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:14.268720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:14.269659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:14.269659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:14.269659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:14.269659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:14.269659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 436/856] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:14.270289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaa710-6c84-411b-abd4-536a8c08819b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.270289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaa710-6c84-411b-abd4-536a8c08819b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.270672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaaa710-6c84-411b-abd4-536a8c08819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.287629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bcaaa710-6c84-411b-abd4-536a8c08819b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:14.288866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bcaaa710-6c84-411b-abd4-536a8c08819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:14.309917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.362362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 421/857] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:33:14.363172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 437/858] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:14.363285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.363961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaa710-6c84-411b-abd4-536a8c08819b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.473367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaaa710-6c84-411b-abd4-536a8c08819b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.474368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4e1bef-42c4-444c-9cc7-cebc49e9ab1c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.488941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.515771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.516492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.516744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.517021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.517402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.517744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:14.518055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.518393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.518748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.519093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.519429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.529688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.531178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.536652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 422/859] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:14.536652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:14.549524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:14.550470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:14.551380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:14.551380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:14.551380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:14.551380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:14.551380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 438/860] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:14.551664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.564744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.652457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa3da0-aefd-42be-836f-47bdf7cd58e9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.666182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fd827-19f8-472c-81e9-a532f43b5a38 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.692942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.694334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.694804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.695502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.696365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.698133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.706751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.707548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.707836 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.708117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:14.714745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:14.715897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:14.716955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:14.717826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.717826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.724036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 423/861] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:14.724036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:14.737257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:14.744934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 439/862] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:14.747785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.761619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.816270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:14.838863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee16a-b286-430d-8951-cf5460d8fc97 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.851405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ba81e-6d0c-40bd-b4c6-8a7e287a4f17 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:14.875877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.876617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.876907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.877186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.877909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:14.878219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.879610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.887233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:14.887889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:14.888177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:14.888491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:14.889227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:14.889554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:14.890901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:14.892912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 424/863] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:14.893970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.899845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 440/864] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:14.900670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:14.999522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:15.006953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4348fa7-ab10-41e6-9af4-fbde6fa8bbee None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:15.015803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82744e33-595e-4e76-bf6b-81080b5fbe7e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:15.042224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:15.042891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.043178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.043459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.044246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:15.044597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:15.046127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:15.046952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:15.051860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:15.052874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.052984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.053235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.063319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 425/865] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:15.063319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:15.063587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:15.063587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:15.083001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:15.084015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 441/866] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:15.085304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:15.197843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf57e04-3c01-4088-9c69-20474a7f6358 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:15.208603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b8d7-8a81-4ba4-bf44-e8e6b9cf8e72 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:15.246746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:15.247471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.247743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.248074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.249485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:15.249658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=4599a196029c4f73b8428250cc19f8d3) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:15.249924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:15.251043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.251457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:15.251710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.252166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.253096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:15.253894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:15.256346 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:15.266358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 442/867] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:15 2022] GET /identity/v3/role_assignments?user.id=4599a196029c4f73b8428250cc19f8d3&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:15.266358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:15.284579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 426/868] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:15.380280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:15.438930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de321a-6890-4166-8068-6e83bd8437a0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:15.523175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e7946-a005-4f06-a77d-99d5488b2e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:15.523868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7946-a005-4f06-a77d-99d5488b2e56 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.524160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7946-a005-4f06-a77d-99d5488b2e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.524526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e7946-a005-4f06-a77d-99d5488b2e56 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.525277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7946-a005-4f06-a77d-99d5488b2e56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:15.525594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7946-a005-4f06-a77d-99d5488b2e56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:15.527029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e7946-a005-4f06-a77d-99d5488b2e56 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:15.546897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 443/869] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:15.556487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:15.582359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:15.683125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db982840-e769-4900-bf67-d790b065ed8c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:15.721469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02abdc9-c2b1-427c-9a7b-60fa6cb91a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:15.722525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abdc9-c2b1-427c-9a7b-60fa6cb91a90 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.723028 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abdc9-c2b1-427c-9a7b-60fa6cb91a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.723522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02abdc9-c2b1-427c-9a7b-60fa6cb91a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.724604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02abdc9-c2b1-427c-9a7b-60fa6cb91a90 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=6d3513ec025a448cad13fead94966aac) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:15.725128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02abdc9-c2b1-427c-9a7b-60fa6cb91a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:15.726776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02abdc9-c2b1-427c-9a7b-60fa6cb91a90 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:15.735246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 427/870] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:15 2022] GET /identity/v3/role_assignments?user.id=6d3513ec025a448cad13fead94966aac&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:15.823453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75a3b8-fde3-413f-ae6d-ef221f8c5343 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.823651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75a3b8-fde3-413f-ae6d-ef221f8c5343 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.823911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75a3b8-fde3-413f-ae6d-ef221f8c5343 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.825813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 444/871] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:15.831543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c6321-1e7b-47d2-bf94-d455cd4d6e3a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:15.831843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c6321-1e7b-47d2-bf94-d455cd4d6e3a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:15.832261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5c6321-1e7b-47d2-bf94-d455cd4d6e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:15.865492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6c5c6321-1e7b-47d2-bf94-d455cd4d6e3a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:15.866821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6c5c6321-1e7b-47d2-bf94-d455cd4d6e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:15.948699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 428/872] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:15.972265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75a3b8-fde3-413f-ae6d-ef221f8c5343 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:16.086345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75a3b8-fde3-413f-ae6d-ef221f8c5343 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:16.104530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:16.122275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1821142c-70e9-4dc2-8997-8d733408da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:16.122902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821142c-70e9-4dc2-8997-8d733408da4e None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:16.123186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821142c-70e9-4dc2-8997-8d733408da4e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:16.123461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1821142c-70e9-4dc2-8997-8d733408da4e None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:16.124191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821142c-70e9-4dc2-8997-8d733408da4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:16.125643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1821142c-70e9-4dc2-8997-8d733408da4e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:16.208063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 445/873] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:15 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:17.753587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565bc9-9c88-4bc0-bb43-4f91a66b5bc0 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:17.754089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565bc9-9c88-4bc0-bb43-4f91a66b5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:17.754089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f565bc9-9c88-4bc0-bb43-4f91a66b5bc0 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:17.755647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 429/874] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:17.761070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0452e5b-4643-44b8-8241-64c6644fbaa9 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:17.761495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0452e5b-4643-44b8-8241-64c6644fbaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:17.761670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0452e5b-4643-44b8-8241-64c6644fbaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:17.781334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a0452e5b-4643-44b8-8241-64c6644fbaa9 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:17.782567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a0452e5b-4643-44b8-8241-64c6644fbaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:17.783277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c6020-d0f5-4b9f-afc7-10f73b703a73 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:17.783904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c6020-d0f5-4b9f-afc7-10f73b703a73 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:17.784432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c6020-d0f5-4b9f-afc7-10f73b703a73 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:17.786022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 430/875] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:17.791598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de225-dcb3-474b-93ce-bc078628a378 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:17.791893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de225-dcb3-474b-93ce-bc078628a378 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:17.792174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0de225-dcb3-474b-93ce-bc078628a378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:17.814854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0f0de225-dcb3-474b-93ce-bc078628a378 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:17.816348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0f0de225-dcb3-474b-93ce-bc078628a378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:17.826294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:17.876207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 446/876] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:17.902339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0452e5b-4643-44b8-8241-64c6644fbaa9 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:17.913070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 431/877] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:17.938986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0de225-dcb3-474b-93ce-bc078628a378 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.012104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0452e5b-4643-44b8-8241-64c6644fbaa9 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.013605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.049810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8346ec-d844-4e14-a6b3-4f647d273e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.050607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8346ec-d844-4e14-a6b3-4f647d273e53 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.051008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8346ec-d844-4e14-a6b3-4f647d273e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.051364 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8346ec-d844-4e14-a6b3-4f647d273e53 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.052177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8346ec-d844-4e14-a6b3-4f647d273e53 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:18.053650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8346ec-d844-4e14-a6b3-4f647d273e53 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:18.055027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0de225-dcb3-474b-93ce-bc078628a378 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.091899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.094142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.098176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.098176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.098176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:18.098176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:18.110613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:18.111622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:18.112505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:18.113901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 432/878] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:18.117845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.128940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.173011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 447/879] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:17 2022] POST /identity/v3/services => generated 269 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:18.243912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68396-85ac-41f4-9d00-3d7905d637ee None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.244286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68396-85ac-41f4-9d00-3d7905d637ee None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.244517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d68396-85ac-41f4-9d00-3d7905d637ee None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.246299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 448/880] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:18.252548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a636c7-a090-4f5e-97f5-1ef4af7e5693 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.252950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a636c7-a090-4f5e-97f5-1ef4af7e5693 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.253140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a636c7-a090-4f5e-97f5-1ef4af7e5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.262515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5209b87-b291-4e58-b125-69d53f48e5ee None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.270884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-98a636c7-a090-4f5e-97f5-1ef4af7e5693 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:18.272110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-98a636c7-a090-4f5e-97f5-1ef4af7e5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:18.319744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.320440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.320762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.321465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.321734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:18.322042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:18.323447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:18.334633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 433/881] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:18.335625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.362988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 449/882] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:18.388717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a636c7-a090-4f5e-97f5-1ef4af7e5693 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.429331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.485623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4cf497-087a-4fde-af2b-e7230400efed None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.504743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.517725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a636c7-a090-4f5e-97f5-1ef4af7e5693 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.535838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ea97f-7fe9-42ad-a8aa-3ab0754cdf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.536924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ea97f-7fe9-42ad-a8aa-3ab0754cdf6b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.537469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ea97f-7fe9-42ad-a8aa-3ab0754cdf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.538246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ea97f-7fe9-42ad-a8aa-3ab0754cdf6b None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.541055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ea97f-7fe9-42ad-a8aa-3ab0754cdf6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:18.541981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ea97f-7fe9-42ad-a8aa-3ab0754cdf6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:18.544779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ea97f-7fe9-42ad-a8aa-3ab0754cdf6b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:18.551350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 434/883] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:18.562998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.564143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.564625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.565079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.571648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019656-f98a-4963-bc29-b286172f322c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.572255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019656-f98a-4963-bc29-b286172f322c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.572780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53019656-f98a-4963-bc29-b286172f322c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.579374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 435/884] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:18.580200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:18.581784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c79b-a15e-4b50-b998-2e8f2a1710d1 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.582287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c79b-a15e-4b50-b998-2e8f2a1710d1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.582749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8c79b-a15e-4b50-b998-2e8f2a1710d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:18.590684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:18.591707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:18.593366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 450/885] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:18.598470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.606766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-10f8c79b-a15e-4b50-b998-2e8f2a1710d1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:18.608368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-10f8c79b-a15e-4b50-b998-2e8f2a1710d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:18.695883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 436/886] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:18.720043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8c79b-a15e-4b50-b998-2e8f2a1710d1 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.729239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae6880-ff96-4f9b-820b-39f9d1af65be None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.782221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.782816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.783110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.783395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.784164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:18.784518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:18.786424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:18.792545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.795703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 451/887] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:18.801322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.828241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:18.837672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8c79b-a15e-4b50-b998-2e8f2a1710d1 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.875471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.876289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.876625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.876909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.877611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:18.879003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:18.892348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:18.893485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:18.894956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 437/888] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:18.899388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:18.939422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a495-cc07-4402-9925-d07f7f14967c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:18.977395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:18.978602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:18.979363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:18.979848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:18.997849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.001093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.008903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a95ac-ebb4-4ef4-b604-5bdd887821d4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:19.024725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:19.025664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:19.026552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:19.026552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:19.026552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:19.026552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:19.029565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 452/889] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:19.036971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:19.041159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:19.057286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.066878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.066878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.066878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.066878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:19.066878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.066878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.070692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 438/890] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:19.075919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:19.120510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:19.157478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553beb-0ca6-4a8e-9903-d46fe512f6a8 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.194729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.195721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.196185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.196741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.197798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:19.198294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.199853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.212602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dd4cc-64a3-417d-ada9-7c03f828d11f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.218342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 453/891] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:19.219331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:19.258337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.259303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.260297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.260759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.261634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:19.262623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.265469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.277068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 439/892] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:19.279204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:19.325964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6cd37-9883-45f1-b2e0-7a07eec36f68 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.352731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:19.359390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:19.364185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.365038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.365323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.365601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.374831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.376476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.397124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4381d9e-d41b-422d-8c3d-c0ef139b6a0e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:19.397330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:19.398225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:19.399195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:19.403464 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 454/893] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:19.406164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:19.440441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.441559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.442115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.442604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.443899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] RBAC: Adding query filter params (interface=public, service_id=5f9819bf286f476fa0287baa2601d38f, region_id=RegionOne) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:19.444571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.446172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.457849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 440/894] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/endpoints?service_id=5f9819bf286f476fa0287baa2601d38f&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:19.463291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:19.527451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecd177-8b8c-4298-869d-4aa81d1050b4 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.573855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.575483 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.576158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.576789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.578441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:19.578957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.580615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.594424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8e193-297f-4a49-81b2-bd6f5a7045bc None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.610401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 455/895] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:19.611140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:19.616944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:19.635925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.636672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.637019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.637308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.637995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.639428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.652449 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 441/896] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:33:19.679771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:19.738550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3159b41d-d69b-4227-874c-dace14f022a2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:19.777618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:19.778580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:19.779023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:19.779472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:19.863922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:19.865360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:19.914398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:19.978923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 456/897] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:33:19.984752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.091383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c82bb-dca0-4d8e-aabd-95410ce90a69 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:20.127158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:20.127865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.128146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.128429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.139719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:20.141205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:20.158301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:20.161252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:20.162155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:20.162155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:20.162155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:20.162155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:20.162155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 442/898] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:20.165390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.281018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f3a7e2-399e-498e-b491-ec94cf2a93a2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:20.318183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:20.318851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.319138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.319419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.320233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:20.320585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:20.322018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:20.335352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 457/899] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:20.340435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.373208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:20.448755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51288a-23ec-4731-9a94-15a1841d5037 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:20.487120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ec15d-cdba-4798-b32f-d47d5370fe46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:20.492424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec15d-cdba-4798-b32f-d47d5370fe46 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.492424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec15d-cdba-4798-b32f-d47d5370fe46 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.492424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec15d-cdba-4798-b32f-d47d5370fe46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.497941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ec15d-cdba-4798-b32f-d47d5370fe46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:20.497941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ec15d-cdba-4798-b32f-d47d5370fe46 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-1d6ec15d-cdba-4798-b32f-d47d5370fe46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:20.512816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:20.513728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:20.514672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 443/900] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:20.520132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.524077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:20.537064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926fa79-2c41-4b58-9072-ae18ed2644d5 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.537344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926fa79-2c41-4b58-9072-ae18ed2644d5 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.542768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926fa79-2c41-4b58-9072-ae18ed2644d5 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.542768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 444/901] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:20.544251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240f9c-0e8d-4a68-a7ca-53ac6fbbdbd7 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.544606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240f9c-0e8d-4a68-a7ca-53ac6fbbdbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.544889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75240f9c-0e8d-4a68-a7ca-53ac6fbbdbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.565283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-75240f9c-0e8d-4a68-a7ca-53ac6fbbdbd7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:20.566836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-75240f9c-0e8d-4a68-a7ca-53ac6fbbdbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:20.629952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649075a-f3c2-40ce-bbdf-956ce8fd85a0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:20.644725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 445/902] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:20.664735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240f9c-0e8d-4a68-a7ca-53ac6fbbdbd7 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.666755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:20.667556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.667861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.668145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.669162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:20.669484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:20.671486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:20.686525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 458/903] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:20.700564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.700752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:20.763900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:20.787627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75240f9c-0e8d-4a68-a7ca-53ac6fbbdbd7 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:20.805009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa06ba-511b-4731-8970-307d5affadd3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:20.824919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:20.825952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.826379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.827353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.828279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:20.829863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:20.843590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3dd564-ba11-47c8-b607-efc3fe95c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:20.844376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd564-ba11-47c8-b607-efc3fe95c649 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:20.844600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:20.845686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:20.846544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:20.847324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd564-ba11-47c8-b607-efc3fe95c649 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:20.847324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3dd564-ba11-47c8-b607-efc3fe95c649 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:20.847324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dd564-ba11-47c8-b607-efc3fe95c649 None admin] RBAC: Adding query filter params (role.id=e09ce114d5de4d539b217bd3bfcd75d6, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=6d3513ec025a448cad13fead94966aac) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:20.847324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dd564-ba11-47c8-b607-efc3fe95c649 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:20.848971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3dd564-ba11-47c8-b607-efc3fe95c649 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:20.849762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 446/904] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jun 2 13:33:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:20.855412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:20.864433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 459/905] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:20 2022] GET /identity/v3/role_assignments?user.id=6d3513ec025a448cad13fead94966aac&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=e09ce114d5de4d539b217bd3bfcd75d6 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:20.972169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:20.988836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8bce58-740f-44b3-9fae-3d4e40a00ce0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:21.029401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:21.030126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.030414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.030698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.031189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611074-64df-47bf-8fde-523094e8cf63 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.031430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:21.031526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611074-64df-47bf-8fde-523094e8cf63 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.031743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:21.031852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4611074-64df-47bf-8fde-523094e8cf63 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.033202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:21.036427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 460/906] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:21.039065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 447/907] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:21.039544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f39465-6381-475a-b2bc-0157e3243cf4 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.040035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f39465-6381-475a-b2bc-0157e3243cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.040582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f39465-6381-475a-b2bc-0157e3243cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.046268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:21.060373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a7f39465-6381-475a-b2bc-0157e3243cf4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:21.062617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a7f39465-6381-475a-b2bc-0157e3243cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:21.148189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 461/908] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:21.169167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2de0e-9644-4da3-a36b-cdca2b2860bd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:21.177496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f39465-6381-475a-b2bc-0157e3243cf4 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:21.208858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:21.209519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.209801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.210076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.210785 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:21.211092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:21.212512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:21.218345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 448/909] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:21.224868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:21.250567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:21.252595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:21.295204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f39465-6381-475a-b2bc-0157e3243cf4 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:21.333072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69c88c-4bd3-40a3-bcea-7953af62ed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:21.334125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c88c-4bd3-40a3-bcea-7953af62ed79 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.334610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c88c-4bd3-40a3-bcea-7953af62ed79 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.335083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69c88c-4bd3-40a3-bcea-7953af62ed79 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.335994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c88c-4bd3-40a3-bcea-7953af62ed79 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:21.337718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69c88c-4bd3-40a3-bcea-7953af62ed79 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:21.362860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e912d-7be3-447d-8345-c88703f70ae3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:21.398913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:21.399578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.399866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.400148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.400982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] RBAC: Adding query filter params (interface=public, service_id=b2f9d9e05ea9454ba9b40af717da74c9, region_id=RegionOne) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:21.401325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:21.402928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:21.413471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 449/910] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:33:21 2022] GET /identity/v3/endpoints?service_id=b2f9d9e05ea9454ba9b40af717da74c9&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:21.415102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:21.423958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 462/911] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:21 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:21.527903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:21.554121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb1b25b-1330-4af1-bf34-9bca6d323548 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:21.601857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab81d89-6b97-44fa-9399-1e0749eaaaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:21.602543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab81d89-6b97-44fa-9399-1e0749eaaaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:21.602833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab81d89-6b97-44fa-9399-1e0749eaaaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:21.603115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab81d89-6b97-44fa-9399-1e0749eaaaf0 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:21.604069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab81d89-6b97-44fa-9399-1e0749eaaaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:21.605612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab81d89-6b97-44fa-9399-1e0749eaaaf0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:21.614836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 450/912] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:21 2022] GET /identity/v3/services => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:33:22.088799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2acea8-6515-4824-833c-2f0507d9685d None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.089539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2acea8-6515-4824-833c-2f0507d9685d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.089539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2acea8-6515-4824-833c-2f0507d9685d None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.090987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 463/913] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:22.097196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9b22f-72a9-4e31-a478-2d000a5d6c66 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.098054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9b22f-72a9-4e31-a478-2d000a5d6c66 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.098541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9b22f-72a9-4e31-a478-2d000a5d6c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.117660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-efc9b22f-72a9-4e31-a478-2d000a5d6c66 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:22.119205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-efc9b22f-72a9-4e31-a478-2d000a5d6c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:22.197562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 451/914] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:22.220113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2acea8-6515-4824-833c-2f0507d9685d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:22.328971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2acea8-6515-4824-833c-2f0507d9685d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:22.346580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:22.370275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:22.371325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.371778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.372221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.373053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:22.375257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:22.389055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:22.390352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 02 13:33:22.391458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:22.393909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 464/915] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:22.399992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9b22f-72a9-4e31-a478-2d000a5d6c66 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:22.484929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:22.525375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9b22f-72a9-4e31-a478-2d000a5d6c66 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:22.562786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:22.563777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.564302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.564836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.565753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:22.566272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:22.567902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:22.574258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 452/916] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:22.580849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:22.688231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c20933-187b-442a-b68b-ef301046374a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:22.724819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8a72e-1304-4adb-af5c-9ae91263a0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:22.725481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8a72e-1304-4adb-af5c-9ae91263a0df None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.725766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8a72e-1304-4adb-af5c-9ae91263a0df None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.726047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8a72e-1304-4adb-af5c-9ae91263a0df None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.726756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8a72e-1304-4adb-af5c-9ae91263a0df None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:22.727059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8a72e-1304-4adb-af5c-9ae91263a0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:22.728436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8a72e-1304-4adb-af5c-9ae91263a0df None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:22.734419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 465/917] 10.222.0.33 () {56 vars in 1114 bytes} [Thu Jun 2 13:33:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:22.740048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:22.846365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c0c2e-cb8b-45d0-bcce-41eda1dc3dda None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:22.878763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:22.884156 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf88962-7253-4e16-b33b-93139634fd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:22.892238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88962-7253-4e16-b33b-93139634fd81 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:22.892238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88962-7253-4e16-b33b-93139634fd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:22.892238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf88962-7253-4e16-b33b-93139634fd81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:22.892238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf88962-7253-4e16-b33b-93139634fd81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:22.892238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf88962-7253-4e16-b33b-93139634fd81 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:22.982209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 453/918] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:23.290525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0baf-be0b-4b08-9997-ecf702bb9931 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.291017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0baf-be0b-4b08-9997-ecf702bb9931 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.291017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a0baf-be0b-4b08-9997-ecf702bb9931 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.292624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 466/919] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:23.297892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47c2c7-31d0-439d-a7ec-d33dd3628b0f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.298336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47c2c7-31d0-439d-a7ec-d33dd3628b0f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.298490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47c2c7-31d0-439d-a7ec-d33dd3628b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.315936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4d47c2c7-31d0-439d-a7ec-d33dd3628b0f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:23.317151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4d47c2c7-31d0-439d-a7ec-d33dd3628b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:23.395416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 454/920] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:23.417503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a0baf-be0b-4b08-9997-ecf702bb9931 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:23.470603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:23.539377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a0baf-be0b-4b08-9997-ecf702bb9931 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:23.574952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:23.575689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.575978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.576255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.588047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:23.596389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:23.597355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:23.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 467/921] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 2 13:33:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:23.604104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47c2c7-31d0-439d-a7ec-d33dd3628b0f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:23.713761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47c2c7-31d0-439d-a7ec-d33dd3628b0f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:23.728836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:23.752757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d38eb48-16b0-4a69-b312-1def61dad431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:23.753800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38eb48-16b0-4a69-b312-1def61dad431 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.754286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38eb48-16b0-4a69-b312-1def61dad431 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.754762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d38eb48-16b0-4a69-b312-1def61dad431 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.755718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38eb48-16b0-4a69-b312-1def61dad431 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:23.756222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38eb48-16b0-4a69-b312-1def61dad431 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:23.757828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d38eb48-16b0-4a69-b312-1def61dad431 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:23.766677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 455/922] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 2 13:33:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:23.772670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:23.830499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd16c-97e4-4130-ad37-bf3f63b6b556 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.831139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd16c-97e4-4130-ad37-bf3f63b6b556 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.831633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd16c-97e4-4130-ad37-bf3f63b6b556 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.833323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 456/923] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:23.839166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431e5c9-cc48-4ded-9c60-09bdc47e72dd None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.839696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431e5c9-cc48-4ded-9c60-09bdc47e72dd None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.840191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431e5c9-cc48-4ded-9c60-09bdc47e72dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.860735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e431e5c9-cc48-4ded-9c60-09bdc47e72dd None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:23.862513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e431e5c9-cc48-4ded-9c60-09bdc47e72dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:23.887476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985c40f5-f395-4174-98cc-f35d036d42f2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:23.897173 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:23.929083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:23.930012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:23.930387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:23.930885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:23.945195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:23.946902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:23.948541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 457/924] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:23.969758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:23.970675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:23.971570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:23.971570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:23.971570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:23.971570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:23.972950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431e5c9-cc48-4ded-9c60-09bdc47e72dd None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:23.974073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 468/925] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:23.981009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.084467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431e5c9-cc48-4ded-9c60-09bdc47e72dd None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.087604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390c0b-0d80-453d-9f10-781c26a28f52 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.092934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.120007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb1fbf-2586-4ae3-870e-a810cf6c3e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.120820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb1fbf-2586-4ae3-870e-a810cf6c3e5a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.121109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb1fbf-2586-4ae3-870e-a810cf6c3e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.121381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb1fbf-2586-4ae3-870e-a810cf6c3e5a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.122026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb1fbf-2586-4ae3-870e-a810cf6c3e5a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.123938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb1fbf-2586-4ae3-870e-a810cf6c3e5a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.124941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba34f1-5ec5-4eca-8ca3-afd065727b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.125613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba34f1-5ec5-4eca-8ca3-afd065727b31 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.126090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba34f1-5ec5-4eca-8ca3-afd065727b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.126374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba34f1-5ec5-4eca-8ca3-afd065727b31 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.127436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba34f1-5ec5-4eca-8ca3-afd065727b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:24.128833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba34f1-5ec5-4eca-8ca3-afd065727b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.131047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba34f1-5ec5-4eca-8ca3-afd065727b31 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-dfdb1fbf-2586-4ae3-870e-a810cf6c3e5a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:24.138294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:24.139876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.149808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 458/926] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:24.150722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c764-aa9f-4f73-8890-3275e237dcc7 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.150722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c764-aa9f-4f73-8890-3275e237dcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.150722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207c764-aa9f-4f73-8890-3275e237dcc7 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.150722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 459/927] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:24.150969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 469/928] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:24.151043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c764-aa9f-4f73-8890-3275e237dcc7 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.151112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114269a-98de-498a-9b46-e7c14b378b86 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.151461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114269a-98de-498a-9b46-e7c14b378b86 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.151616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114269a-98de-498a-9b46-e7c14b378b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.174360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3114269a-98de-498a-9b46-e7c14b378b86 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:24.175574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3114269a-98de-498a-9b46-e7c14b378b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:24.193218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.264726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 470/929] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:24.264726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114269a-98de-498a-9b46-e7c14b378b86 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.271504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207c764-aa9f-4f73-8890-3275e237dcc7 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.308239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.309070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.309353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.309627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.318031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.319477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:24.335205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:24.336176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.337197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 460/930] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:24.337802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.378501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.390570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114269a-98de-498a-9b46-e7c14b378b86 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.425924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.426585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.426869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.427145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.427853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:24.428159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.429564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.435131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 471/931] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:24.440864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.450685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645cb121-0aad-45ec-8356-465dc67f767d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.456290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.492163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.493268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.493405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.493680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.494321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.495743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:24.509801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:24.510730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.512519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 461/932] 10.222.0.33 () {56 vars in 1132 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:24.513394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.559377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65546009-7e2c-4e14-840b-0b84db1a66f2 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.596854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.597449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.597738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.598019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.598854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:24.599169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.600617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.617559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.623899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 472/933] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:24.625016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.625121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2152f0d-1d92-4a23-9a9d-b8906e3ae9f3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.664276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.665085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.665369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.665649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.666354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:24.666777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.668153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.674057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 462/934] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:24.679535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.697855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.730915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648733c-a50a-499f-ba6c-4a40a57ba9e7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.768509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.769176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.769461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.769738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.770442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:24.770748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.772118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.778418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 473/935] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:24.779400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.784360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b8605c-661f-412d-b698-e5ecdc377ad2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.821007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.821799 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.822080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.822351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.833585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.835046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:24.853245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:24.854626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:24.855765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:24.855765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:24.855765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:24.855765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:24.859878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 463/936] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:24.860782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.874042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.893678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2836b6d-80ab-4852-b984-fba7fa71daba None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:24.931606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:24.932274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:24.932594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:24.932879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:24.933669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] RBAC: Adding query filter params (interface=public, service_id=3a7f34a75d7249c4a8a3cba6b33880dd, region_id=RegionOne) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:24.934010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:24.935374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:24.937743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:24.946214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 474/937] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/endpoints?service_id=3a7f34a75d7249c4a8a3cba6b33880dd&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:24.946214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:24.971819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc55ea-0580-48c2-8af1-a329c6cdd3af None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.010748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.011421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.011709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.011989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.012738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:25.013044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.015014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.024757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 464/938] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:25.024757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:25.056703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ba251-e5f8-41cc-ac91-9cb242cf2fba None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.092715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.093404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.093705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.093979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.094694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:25.095003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.096361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.099345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:25.112965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 475/939] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:25.112965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:25.131125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5d7ce-05d8-4e76-b8a0-97add4b48d4a None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.169872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.170758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.171078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.171325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.172037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.173480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.175550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:25.188835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 465/940] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:25 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:33:25.190194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:25.230799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0c9ca-dad2-4776-bad5-87a197355a7c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.284095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff234a50-2342-40ce-9364-a3eb7bb97246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.285102 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff234a50-2342-40ce-9364-a3eb7bb97246 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.285656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff234a50-2342-40ce-9364-a3eb7bb97246 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.286151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff234a50-2342-40ce-9364-a3eb7bb97246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.287194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff234a50-2342-40ce-9364-a3eb7bb97246 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.289049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff234a50-2342-40ce-9364-a3eb7bb97246 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.325097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa815f2-cf55-42ed-b686-8c030e7a9713 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.363429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c4407-285c-4389-8a01-71b3468e27a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.364149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4407-285c-4389-8a01-71b3468e27a2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.364530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4407-285c-4389-8a01-71b3468e27a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.364818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c4407-285c-4389-8a01-71b3468e27a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.372280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4407-285c-4389-8a01-71b3468e27a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.373886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c4407-285c-4389-8a01-71b3468e27a2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.375739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-916c4407-285c-4389-8a01-71b3468e27a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:25.390187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:25.393794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 466/941] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ff7f5-4a6f-4b26-9bd6-9fc6a285e7a3 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.394966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ff7f5-4a6f-4b26-9bd6-9fc6a285e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.396149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ff7f5-4a6f-4b26-9bd6-9fc6a285e7a3 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.396149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 467/942] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:25.397033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ff7f5-4a6f-4b26-9bd6-9fc6a285e7a3 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:25.431452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 476/943] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:25.433016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f716c-ed9f-434e-9389-62b1d8f106fa None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.436566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f716c-ed9f-434e-9389-62b1d8f106fa None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.436566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f716c-ed9f-434e-9389-62b1d8f106fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.456677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9d9f716c-ed9f-434e-9389-62b1d8f106fa None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:25.458006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9d9f716c-ed9f-434e-9389-62b1d8f106fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:25.542847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ff7f5-4a6f-4b26-9bd6-9fc6a285e7a3 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.551487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 477/944] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:25.582648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f716c-ed9f-434e-9389-62b1d8f106fa None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:25.593897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.594703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.594998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.595281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.596091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:25.596439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.598048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.617014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 468/945] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:25.618179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:25.641734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:25.687659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:25.718646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f716c-ed9f-434e-9389-62b1d8f106fa None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.752521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e96a9-f953-4d09-96dc-ed7ddb7e4338 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:25.757733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.758403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.758693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.758973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.759751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.761392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.762786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING keystone.server.flask.common [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 02 13:33:25.793471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:25.794707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:25.795323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:25.795809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/6d3513ec025a448cad13fead94966aac/roles/e09ce114d5de4d539b217bd3bfcd75d6` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:25.798352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=6d3513ec025a448cad13fead94966aac, role_id=e09ce114d5de4d539b217bd3bfcd75d6)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:25.800011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:25.820203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.sql.core [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:33:25.820203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:33:25.820203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [parameters: {'id': '5e0319a189d34082b4aab7883481b596', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:33:25.820203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e0319a189d34082b4aab7883481b596.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e0319a189d34082b4aab7883481b596. Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:33:25.837051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result.read() Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 02 13:33:25.837878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application yield resource Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise self.value Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application session.commit() Jun 02 13:33:25.838819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:33:25.839713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:33:25.846829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result.read() Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:33:25.849046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [parameters: {'id': '5e0319a189d34082b4aab7883481b596', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:25.852349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:25.860903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5e0319a189d34082b4aab7883481b596. Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 478/946] 10.222.0.33 () {60 vars in 1140 bytes} [Thu Jun 2 13:33:25 2022] POST /identity/v3/projects => generated 262 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:25.863387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:25.883999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 469/947] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:33:25 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/6d3513ec025a448cad13fead94966aac/roles/e09ce114d5de4d539b217bd3bfcd75d6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:33:25.981528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:25.987190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95feb221-96fa-40c1-83c9-f575693003c8 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:26.029937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1fdbd-b19a-4254-a6ec-992e8dc86654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:26.031670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1fdbd-b19a-4254-a6ec-992e8dc86654 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:26.032109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1fdbd-b19a-4254-a6ec-992e8dc86654 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:26.032603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1fdbd-b19a-4254-a6ec-992e8dc86654 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:26.040915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1fdbd-b19a-4254-a6ec-992e8dc86654 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:26.044126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1fdbd-b19a-4254-a6ec-992e8dc86654 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e5e1fdbd-b19a-4254-a6ec-992e8dc86654 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:26.060342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:26.062183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:26.063272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:26.065671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 479/948] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:26.071806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:26.189736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070f50f-21b0-4e22-aac5-34289de92479 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:26.205184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:26.226321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc1c06-16ca-475e-8594-319547b3ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:26.227139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1c06-16ca-475e-8594-319547b3ce4b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:26.227520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1c06-16ca-475e-8594-319547b3ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:26.227902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc1c06-16ca-475e-8594-319547b3ce4b None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:26.229101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc1c06-16ca-475e-8594-319547b3ce4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:26.229505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc1c06-16ca-475e-8594-319547b3ce4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:26.231075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc1c06-16ca-475e-8594-319547b3ce4b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:26.250271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 470/949] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:27.515998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d884a21-238a-4fa8-8981-d40c85775b2d None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:27.516519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d884a21-238a-4fa8-8981-d40c85775b2d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:27.516628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d884a21-238a-4fa8-8981-d40c85775b2d None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:27.520954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 480/950] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:27.526495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6a02-4492-47d5-8f10-9b331ffb44cb None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:27.526918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6a02-4492-47d5-8f10-9b331ffb44cb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:27.527113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c6a02-4492-47d5-8f10-9b331ffb44cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:27.544864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4e5c6a02-4492-47d5-8f10-9b331ffb44cb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:27.546119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4e5c6a02-4492-47d5-8f10-9b331ffb44cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:27.620468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 471/951] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:27.644156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d884a21-238a-4fa8-8981-d40c85775b2d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:27.752867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d884a21-238a-4fa8-8981-d40c85775b2d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:27.789222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471735-fb94-4aa3-a9dc-5ead996f41dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:27.790384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471735-fb94-4aa3-a9dc-5ead996f41dc None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:27.790908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471735-fb94-4aa3-a9dc-5ead996f41dc None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:27.791424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471735-fb94-4aa3-a9dc-5ead996f41dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:27.792429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3471735-fb94-4aa3-a9dc-5ead996f41dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:27.794052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3471735-fb94-4aa3-a9dc-5ead996f41dc None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d3471735-fb94-4aa3-a9dc-5ead996f41dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:27.807035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:27.808183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:27.809221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:27.812739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 481/952] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:27.821520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c6a02-4492-47d5-8f10-9b331ffb44cb None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:27.924197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c6a02-4492-47d5-8f10-9b331ffb44cb None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:27.927081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:27.953580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf6c4-d8f7-40da-b989-8cd5683ad293 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:27.953940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf6c4-d8f7-40da-b989-8cd5683ad293 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:27.954180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04abf6c4-d8f7-40da-b989-8cd5683ad293 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:27.959929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 482/953] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:27.961862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3a3ba-8816-4d6b-a8c5-3ce020d4cfd0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:27.962160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3a3ba-8816-4d6b-a8c5-3ce020d4cfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:27.962444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3a3ba-8816-4d6b-a8c5-3ce020d4cfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:27.971178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:27.972266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:27.973043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:27.973527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:27.974483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:27.975012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:27.976723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:27.983839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c7f3a3ba-8816-4d6b-a8c5-3ce020d4cfd0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:27.984185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 472/954] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:27.985421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c7f3a3ba-8816-4d6b-a8c5-3ce020d4cfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:27.992534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.005216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:28.057876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 483/955] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:28.083744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3a3ba-8816-4d6b-a8c5-3ce020d4cfd0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.107184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc218b3-44e2-49d8-ad54-963d9d3b2920 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.152687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:28.153767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.154298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.154815 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.155680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:28.156143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:28.157735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:28.168517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 473/956] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:28.169646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.211293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3a3ba-8816-4d6b-a8c5-3ce020d4cfd0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.211503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:28.250568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:28.251690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.252131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.252706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.253537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:28.255062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:28.268353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:28.269635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:28.270634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:28.272999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 484/957] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:28.279009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.304449 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b7267a-dcb4-4217-a7a7-3806d60974d2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.305622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:28.343944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ec954-0cce-4e2a-8f3f-57c6f67bf2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:28.344659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec954-0cce-4e2a-8f3f-57c6f67bf2a4 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.344951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec954-0cce-4e2a-8f3f-57c6f67bf2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.345237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ec954-0cce-4e2a-8f3f-57c6f67bf2a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.346225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec954-0cce-4e2a-8f3f-57c6f67bf2a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:28.348725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ec954-0cce-4e2a-8f3f-57c6f67bf2a4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:28.401136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab95eac-1232-4ff0-bab3-bf29112b207c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.434641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e5f10-f927-4a23-befc-238a0e6be7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:28.435301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e5f10-f927-4a23-befc-238a0e6be7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.435604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e5f10-f927-4a23-befc-238a0e6be7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.436650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e5f10-f927-4a23-befc-238a0e6be7b3 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.437365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e5f10-f927-4a23-befc-238a0e6be7b3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:28.437677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e5f10-f927-4a23-befc-238a0e6be7b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:28.439040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e5f10-f927-4a23-befc-238a0e6be7b3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:28.443850 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 485/958] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:28.445178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c749-687e-4a20-9fa5-ad6526d40720 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.445463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c749-687e-4a20-9fa5-ad6526d40720 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.445743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2c749-687e-4a20-9fa5-ad6526d40720 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.447127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 486/959] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:28.449427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2c749-687e-4a20-9fa5-ad6526d40720 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.512430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 474/960] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:28 2022] POST /identity/v3/endpoints => generated 349 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:28.512430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063b91-9cc6-46a3-b08c-b5fcc6e81b07 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.512430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063b91-9cc6-46a3-b08c-b5fcc6e81b07 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.512430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80063b91-9cc6-46a3-b08c-b5fcc6e81b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.532110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-80063b91-9cc6-46a3-b08c-b5fcc6e81b07 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:28.533420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-80063b91-9cc6-46a3-b08c-b5fcc6e81b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:28.558020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:28.587212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2c749-687e-4a20-9fa5-ad6526d40720 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.616848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 475/961] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:28.627674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab961b-f63e-45f9-bc0a-c1345c5d18d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:28.628351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab961b-f63e-45f9-bc0a-c1345c5d18d6 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.628674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab961b-f63e-45f9-bc0a-c1345c5d18d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.628958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab961b-f63e-45f9-bc0a-c1345c5d18d6 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.629680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab961b-f63e-45f9-bc0a-c1345c5d18d6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:28.629992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab961b-f63e-45f9-bc0a-c1345c5d18d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:28.631417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab961b-f63e-45f9-bc0a-c1345c5d18d6 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:28.636884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063b91-9cc6-46a3-b08c-b5fcc6e81b07 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.637080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 487/962] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:28.659437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:28.704233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fdb4-ebc1-4386-a0fc-4715a39ae51e None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.704612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fdb4-ebc1-4386-a0fc-4715a39ae51e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.704846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7fdb4-ebc1-4386-a0fc-4715a39ae51e None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.706429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 488/963] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:28.713537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb250-05b9-45be-a9a7-09b07de7eba0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.713900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb250-05b9-45be-a9a7-09b07de7eba0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.714117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876bb250-05b9-45be-a9a7-09b07de7eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.739750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-876bb250-05b9-45be-a9a7-09b07de7eba0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:28.742243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-876bb250-05b9-45be-a9a7-09b07de7eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:28.781780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80063b91-9cc6-46a3-b08c-b5fcc6e81b07 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.827362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:28.828554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:28.828846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:28.829127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:28.834471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 489/964] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:28.846295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:28.855104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:28.856122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:28.857030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 476/965] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 2 13:33:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:28.862084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bb250-05b9-45be-a9a7-09b07de7eba0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.863352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:28.955942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:28.956593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:28.978721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15e346-835c-4abe-a01a-7efcf802ce77 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:28.995326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876bb250-05b9-45be-a9a7-09b07de7eba0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.015379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.016224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.016636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.017017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.017874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:29.018294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.019797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.034120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 477/966] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 2 13:33:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:29.035562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.038077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.039296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.040639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.040943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.041675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.043126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.095122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.sql.core [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:33:29.095122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:33:29.095122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [parameters: {'user_id': '657fa77a246949498ac1fd14e94b28d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:33:29.095122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80597) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result.read() Jun 02 13:33:29.106754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:33:29.108215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application yield resource Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application next(self.gen) Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.session.rollback() Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.force_reraise() Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise self.value Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application session.commit() Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 02 13:33:29.109275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._prepare_impl() Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.session.flush() Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._flush(objects) Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application compat.raise_( Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application flush_context.execute() Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rec.execute(self) Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 02 13:33:29.110174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ Jun 02 13:33:29.111078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result = self._query(query) Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application conn.query(q) Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application result.read() Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 02 13:33:29.111945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [parameters: {'user_id': '657fa77a246949498ac1fd14e94b28d2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:29.114323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 02 13:33:29.116201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 490/967] 10.222.0.33 () {60 vars in 1131 bytes} [Thu Jun 2 13:33:28 2022] POST /identity/v3/users => generated 160 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:29.118680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.184620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275a14b-36c5-416c-88be-b283cccdcd1f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.227867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.229544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.230163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.230689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.236599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a3760-c4f1-4f80-a4dc-5bc78478a1a0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.241726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:29.244743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.246619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:29.267905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:29.269008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:29.270106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:29.270106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:29.270106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:29.270106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:29.271228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 478/968] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:29.275098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.276116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.276681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.277155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.277653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.280387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:29.288648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.290863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:29.312063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:29.313275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 02 13:33:29.314429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:29.317397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 491/969] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:29.325594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.403831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea9657-306c-4600-a21e-db1619546bea None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.443060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.443879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.444245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.444649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.445444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:29.445975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.447432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.463812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bf8cd-773f-4e33-bb35-a34e0c9271e0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.468567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 479/970] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:29.472375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.523909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.524800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.525181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.525804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.527646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:29.528059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.529660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.547236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:29.581945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 492/971] 10.222.0.33 () {56 vars in 1101 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:29.605783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa0ab5-2469-4fe2-9ed5-5e9cde75f321 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.645160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.645992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.646278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.646588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.657046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.658476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:29.675271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:29.676295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:29.677589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 480/972] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:29.685674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.747521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:29.799615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0a835-df16-46af-ae94-1a3cf9c9f9aa None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.834730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:29.835408 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:29.835692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:29.835971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:29.836835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:29.837146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:29.838594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:29.861537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 493/973] 10.222.0.33 () {56 vars in 1149 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:29.867557 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:29.974272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d075e7-0fcb-43a0-b73b-005cb0f14833 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:29.987887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:30.009631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:30.010523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:30.010964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:30.011426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:30.081222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:30.082925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:30.183098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 481/974] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:33:30.188507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:30.289249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a4766-168c-4211-bb58-abeb0b0a4049 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:30.301114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:30.323814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:30.324634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:30.324922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:30.325201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:30.335744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:30.337268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:30.355818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:30.357123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:30.358404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:30.358404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:30.358404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:30.358404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:30.360471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 494/975] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:30.362752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:30.377232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:30.463323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355c896-cc17-4916-ba68-a77a730229e0 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:30.498170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:30.498919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:30.499207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:30.499486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:30.500210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:30.504648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:30.504648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:30.515962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 482/976] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:30.521363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:30.626642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f83434-e63b-4f28-a25c-31880e2e1398 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:30.661056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:30.661878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:30.662164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:30.662441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:30.670474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:30.672142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:30.688194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:30.689491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:30.690441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:30.692614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 495/977] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:30.695728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:30.777056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:30.821741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239a28-412b-4287-b139-18f1d36c8f14 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:30.858310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbfa82-aa26-49f1-9491-20815b643e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:30.859001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbfa82-aa26-49f1-9491-20815b643e83 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:30.859286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbfa82-aa26-49f1-9491-20815b643e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:30.859623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbfa82-aa26-49f1-9491-20815b643e83 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:30.860416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbfa82-aa26-49f1-9491-20815b643e83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:30.860740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbfa82-aa26-49f1-9491-20815b643e83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:30.862169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbfa82-aa26-49f1-9491-20815b643e83 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:30.874915 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 483/978] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:30.880764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:30.907344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:30.985736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4df33-3dab-4ec2-8dc5-8a9db1b1b9b1 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.018263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49673344-0b1a-4694-b9bf-1f4b318ca855 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.018583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49673344-0b1a-4694-b9bf-1f4b318ca855 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.018867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49673344-0b1a-4694-b9bf-1f4b318ca855 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.020539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 484/979] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:31.021360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b02f42-fdec-4d1c-a4f5-22c1b5b4a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.021616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02f42-fdec-4d1c-a4f5-22c1b5b4a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.021792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02f42-fdec-4d1c-a4f5-22c1b5b4a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.022069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b02f42-fdec-4d1c-a4f5-22c1b5b4a4c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.022877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40494f46-e6b2-4f04-84c8-d04749328377 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.022988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b02f42-fdec-4d1c-a4f5-22c1b5b4a4c1 None admin] RBAC: Adding query filter params (role.id=e09ce114d5de4d539b217bd3bfcd75d6, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=6d3513ec025a448cad13fead94966aac) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:31.023157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40494f46-e6b2-4f04-84c8-d04749328377 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.023251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b02f42-fdec-4d1c-a4f5-22c1b5b4a4c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.023434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40494f46-e6b2-4f04-84c8-d04749328377 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.024753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b02f42-fdec-4d1c-a4f5-22c1b5b4a4c1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:31.024855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 485/980] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:31.025838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826156-0e37-48a3-83ae-b021b74ce570 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.026113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826156-0e37-48a3-83ae-b021b74ce570 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.026425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826156-0e37-48a3-83ae-b021b74ce570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.031711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 496/981] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:30 2022] GET /identity/v3/role_assignments?user.id=6d3513ec025a448cad13fead94966aac&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=e09ce114d5de4d539b217bd3bfcd75d6 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:31.034254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79879b-787d-4e88-a02b-29cc4c3925ff None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.034549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79879b-787d-4e88-a02b-29cc4c3925ff None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.034833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c79879b-787d-4e88-a02b-29cc4c3925ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.044493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-66826156-0e37-48a3-83ae-b021b74ce570 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:31.046424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-66826156-0e37-48a3-83ae-b021b74ce570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:31.055253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0c79879b-787d-4e88-a02b-29cc4c3925ff None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:31.056942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0c79879b-787d-4e88-a02b-29cc4c3925ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:31.125694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 486/982] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:31.136508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 497/983] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:31.149685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826156-0e37-48a3-83ae-b021b74ce570 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:31.160682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79879b-787d-4e88-a02b-29cc4c3925ff None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:31.182790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:31.224706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:31.271136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826156-0e37-48a3-83ae-b021b74ce570 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.284578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c79879b-787d-4e88-a02b-29cc4c3925ff None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.310219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.311104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.311395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.311674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.312431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.313824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:31.321102 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.321915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.322207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.322489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.323142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.324543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:31.337037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:31.338246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:31.339603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 498/984] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:31.344743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:31.426673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:31.444594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 487/985] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:31 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:31.447517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4964d7-2539-445c-bcab-c9288c630019 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.507757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.508529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.508821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.509102 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.509818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:31.510133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.511686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:31.518745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 499/986] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:31.524648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:31.636721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de45eda-ffc0-4382-b1d0-0b69e8489ab8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.662232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:31.674432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.675101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.675391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.675808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.676503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:31.686086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.686086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:31.686086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 488/987] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:31.689437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:31.795986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c9a64-377b-4e4f-b236-7f28096510f5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.840714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffff016-5938-48dc-80a2-f03caacee9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.841382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff016-5938-48dc-80a2-f03caacee9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.841678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff016-5938-48dc-80a2-f03caacee9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.841994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff016-5938-48dc-80a2-f03caacee9f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.842966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffff016-5938-48dc-80a2-f03caacee9f4 None admin] RBAC: Adding query filter params (interface=admin, service_id=3a7f34a75d7249c4a8a3cba6b33880dd, region_id=RegionOne) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:31.843286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffff016-5938-48dc-80a2-f03caacee9f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.844698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffff016-5938-48dc-80a2-f03caacee9f4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:31.850591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 500/988] 10.222.0.33 () {56 vars in 1249 bytes} [Thu Jun 2 13:33:31 2022] GET /identity/v3/endpoints?service_id=3a7f34a75d7249c4a8a3cba6b33880dd&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:31.857009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:31.960125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e4efb-49a1-444b-b527-3d0c4ac5f28d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:31.994500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3c8d8-77f6-47f4-b4e6-5a6eb512d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:31.995170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c8d8-77f6-47f4-b4e6-5a6eb512d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:31.995460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c8d8-77f6-47f4-b4e6-5a6eb512d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:31.995743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c8d8-77f6-47f4-b4e6-5a6eb512d0d8 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:31.996447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c8d8-77f6-47f4-b4e6-5a6eb512d0d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:31.997830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c8d8-77f6-47f4-b4e6-5a6eb512d0d8 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:32.004907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 489/989] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:31 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:33:33.322504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5148bb-1ddc-4796-b1e4-87b4edcd01fe None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:33.323029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5148bb-1ddc-4796-b1e4-87b4edcd01fe None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:33.323107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5148bb-1ddc-4796-b1e4-87b4edcd01fe None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:33.324831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 501/990] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:33.330481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84473cc-542f-4eb1-b946-3aa9336f0899 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:33.331213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84473cc-542f-4eb1-b946-3aa9336f0899 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:33.331646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84473cc-542f-4eb1-b946-3aa9336f0899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:33.348889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e84473cc-542f-4eb1-b946-3aa9336f0899 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:33.350293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e84473cc-542f-4eb1-b946-3aa9336f0899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:33.398117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:33.418820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 490/991] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:33.441621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5148bb-1ddc-4796-b1e4-87b4edcd01fe None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:33.445528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:33.555518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5148bb-1ddc-4796-b1e4-87b4edcd01fe None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:33.589694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:33.590450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:33.590732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:33.591022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] PATH_INFO: `/v3/services/image` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:33.591712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:33.593625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:33.605263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:33.606269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:33.607114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 502/992] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jun 2 13:33:33 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:33.614207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84473cc-542f-4eb1-b946-3aa9336f0899 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:33.718367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84473cc-542f-4eb1-b946-3aa9336f0899 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:33.756894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3c0bc-e9f4-4fa2-90e9-05af056e696e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:33.757975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c0bc-e9f4-4fa2-90e9-05af056e696e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:33.758456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c0bc-e9f4-4fa2-90e9-05af056e696e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:33.758774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3c0bc-e9f4-4fa2-90e9-05af056e696e None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:33.759833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c0bc-e9f4-4fa2-90e9-05af056e696e None admin] RBAC: Adding query filter params (name=image) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:33.760149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c0bc-e9f4-4fa2-90e9-05af056e696e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:33.761674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3c0bc-e9f4-4fa2-90e9-05af056e696e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:33.774978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 491/993] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:33.778186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:33.805080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26b0cc-6f3a-44cf-a0c9-63d10b2dcbc1 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:33.805353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26b0cc-6f3a-44cf-a0c9-63d10b2dcbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:33.805638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26b0cc-6f3a-44cf-a0c9-63d10b2dcbc1 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:33.807128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 492/994] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:33.812679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1bab7-15bb-443e-b80a-2d2ed74692b4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:33.812974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1bab7-15bb-443e-b80a-2d2ed74692b4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:33.813258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1bab7-15bb-443e-b80a-2d2ed74692b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:33.830215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-23c1bab7-15bb-443e-b80a-2d2ed74692b4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:33.831416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-23c1bab7-15bb-443e-b80a-2d2ed74692b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:33.850391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:33.875042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:33.885852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead1d69-0d5d-4dd2-88b6-7fbaeaef87eb None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:33.904102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 493/995] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:33.922932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:33.923959 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:33.924490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:33.924985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:33.925902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] RBAC: Adding query filter params (type=image) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:33.926427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:33.926549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1bab7-15bb-443e-b80a-2d2ed74692b4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:33.928149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:33.940825 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 503/996] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:34.041766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1bab7-15bb-443e-b80a-2d2ed74692b4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.079980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.080824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.081109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.081386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.082049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.083480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:34.096371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:34.097470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:34.098398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 494/997] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:34.104495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.213602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dc1d9-bc31-4c72-9299-b01e1c01f955 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.299430 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:34.305072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d002370-539a-4809-9dda-82db1464db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.305743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002370-539a-4809-9dda-82db1464db57 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.306101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002370-539a-4809-9dda-82db1464db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.306381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d002370-539a-4809-9dda-82db1464db57 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.307092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002370-539a-4809-9dda-82db1464db57 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:34.307399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002370-539a-4809-9dda-82db1464db57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.308818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d002370-539a-4809-9dda-82db1464db57 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.319327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 504/998] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:34.320591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.329441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce000985-4ea3-4801-8b6b-7a25447680e1 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.329923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce000985-4ea3-4801-8b6b-7a25447680e1 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.330002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce000985-4ea3-4801-8b6b-7a25447680e1 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.331500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 505/999] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:34.336607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312855-e942-4797-9e0e-dc3bdbc906fc None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.336898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312855-e942-4797-9e0e-dc3bdbc906fc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.337194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe312855-e942-4797-9e0e-dc3bdbc906fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.357875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-fe312855-e942-4797-9e0e-dc3bdbc906fc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:34.357875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fe312855-e942-4797-9e0e-dc3bdbc906fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:34.363794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:34.427962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 506/1000] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:34.438187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268af1c-57d6-46db-846f-511c6ca7b5c3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.451609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312855-e942-4797-9e0e-dc3bdbc906fc None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.475586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.476843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.477381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.477861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.478993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:34.479584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.481741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.489942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 495/1001] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:34.495985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.569151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe312855-e942-4797-9e0e-dc3bdbc906fc None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.597376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:34.607444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.614758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.614758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.614758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.614758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.614758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.615746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b80e5-9100-46f5-98e5-6bcd741ea20b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.617481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:34.624340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:34.625378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:34.629356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 507/1002] 10.222.0.33 () {56 vars in 1126 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:34.631911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.654819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.655498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.655773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.656050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.656869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] RBAC: Adding query filter params (interface=public, service_id=dfd1c407500d4c75916d50d2791fbec2, region_id=RegionOne) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:34.657446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.658562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.663843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 496/1003] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/endpoints?service_id=dfd1c407500d4c75916d50d2791fbec2&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:34.669224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.757696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f98f0f-3036-4f6b-a70c-72d27e88b5dd None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.775354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dd8d8-1a20-43c1-9bdb-ca8b4d190566 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.793681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.794354 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.794643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.795606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.796283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:34.796626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.798009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.807562 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 508/1004] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:34.809920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:34.817900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.818664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.819022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.819373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.820127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.821537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.828548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 497/1005] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:33:34.872376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:34.923459 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d1207-351d-40b6-820f-43ad494763ee None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:34.960352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038f34c-22f0-44e2-9863-c952e21f1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:34.961074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f34c-22f0-44e2-9863-c952e21f1341 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:34.961364 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f34c-22f0-44e2-9863-c952e21f1341 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:34.961650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038f34c-22f0-44e2-9863-c952e21f1341 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:34.962374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038f34c-22f0-44e2-9863-c952e21f1341 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:34.962688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038f34c-22f0-44e2-9863-c952e21f1341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:34.964094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038f34c-22f0-44e2-9863-c952e21f1341 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:34.975435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 509/1006] 10.222.0.33 () {56 vars in 1122 bytes} [Thu Jun 2 13:33:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:34.976741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:35.011155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:35.087973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487ca1-a83a-4021-a36c-d68a9b860b43 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:35.125330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785d3b8-8ef3-4d0b-bc92-b4efdc7c8dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:35.125912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785d3b8-8ef3-4d0b-bc92-b4efdc7c8dc3 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:35.126200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785d3b8-8ef3-4d0b-bc92-b4efdc7c8dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:35.126477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785d3b8-8ef3-4d0b-bc92-b4efdc7c8dc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:35.127213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785d3b8-8ef3-4d0b-bc92-b4efdc7c8dc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:35.128646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785d3b8-8ef3-4d0b-bc92-b4efdc7c8dc3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:35.272441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 498/1007] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:34 2022] POST /identity/v3/endpoints => generated 325 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:36.238042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b9c-62d2-4af0-9158-2ec8f7f10836 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:36.238674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b9c-62d2-4af0-9158-2ec8f7f10836 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:36.238674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea28b9c-62d2-4af0-9158-2ec8f7f10836 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:36.240107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 510/1008] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:36.245131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dcae4-5a3b-491a-838e-96636e876cbf None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:36.245582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dcae4-5a3b-491a-838e-96636e876cbf None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:36.245820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dcae4-5a3b-491a-838e-96636e876cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:36.262620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-205dcae4-5a3b-491a-838e-96636e876cbf None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:36.263954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-205dcae4-5a3b-491a-838e-96636e876cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:36.337417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 499/1009] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:36.360365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea28b9c-62d2-4af0-9158-2ec8f7f10836 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:36.468488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea28b9c-62d2-4af0-9158-2ec8f7f10836 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:36.490962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:36.512464 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436902a2-c4dc-428a-8395-bf4845f545d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:36.513133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436902a2-c4dc-428a-8395-bf4845f545d6 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:36.513417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436902a2-c4dc-428a-8395-bf4845f545d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:36.514326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436902a2-c4dc-428a-8395-bf4845f545d6 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:36.515166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436902a2-c4dc-428a-8395-bf4845f545d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:36.516555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436902a2-c4dc-428a-8395-bf4845f545d6 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:36.614392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 511/1010] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:36 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:37.182936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3a4c-0fab-42c4-8ed8-ccd776a56122 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.183338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3a4c-0fab-42c4-8ed8-ccd776a56122 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.183536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a3a4c-0fab-42c4-8ed8-ccd776a56122 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.185074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 500/1011] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:37.190847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db152f8-b740-4ac2-8b73-77f207e690c7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.191218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db152f8-b740-4ac2-8b73-77f207e690c7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.191575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db152f8-b740-4ac2-8b73-77f207e690c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.210057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0db152f8-b740-4ac2-8b73-77f207e690c7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:37.211248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0db152f8-b740-4ac2-8b73-77f207e690c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:37.292764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 512/1012] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:37 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:37.317092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a3a4c-0fab-42c4-8ed8-ccd776a56122 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:37.335910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:37.424417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5a3a4c-0fab-42c4-8ed8-ccd776a56122 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:37.459813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f8c3bd-c870-44f4-8026-28a4467daaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:37.460650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8c3bd-c870-44f4-8026-28a4467daaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.460935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8c3bd-c870-44f4-8026-28a4467daaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.461210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f8c3bd-c870-44f4-8026-28a4467daaf9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.461863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8c3bd-c870-44f4-8026-28a4467daaf9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:37.463241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f8c3bd-c870-44f4-8026-28a4467daaf9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-a5f8c3bd-c870-44f4-8026-28a4467daaf9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:37.476177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:37.477466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 02 13:33:37.479074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:37.480321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 501/1013] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:37.486843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db152f8-b740-4ac2-8b73-77f207e690c7 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:37.563001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693ab7-1133-46dd-9e6d-aa70d4993c94 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.563332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693ab7-1133-46dd-9e6d-aa70d4993c94 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.563558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49693ab7-1133-46dd-9e6d-aa70d4993c94 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.565097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 502/1014] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:37.569779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d70f0-45ae-4fdc-9cbf-e2dca4a3d3d7 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.570071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d70f0-45ae-4fdc-9cbf-e2dca4a3d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.570358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d70f0-45ae-4fdc-9cbf-e2dca4a3d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.586886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-db2d70f0-45ae-4fdc-9cbf-e2dca4a3d3d7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:37.588087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-db2d70f0-45ae-4fdc-9cbf-e2dca4a3d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:37.593541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db152f8-b740-4ac2-8b73-77f207e690c7 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:37.596843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:37.637853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:37.638608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.638928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.639306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.639924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:37.640354 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:37.641664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:37.646797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 513/1015] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:37.652355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:37.660457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 503/1016] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:37 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:37.681326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d70f0-45ae-4fdc-9cbf-e2dca4a3d3d7 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:37.693254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:37.761215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3fea-388f-4bf4-8332-9c9fd6acb4b9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:37.793024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d70f0-45ae-4fdc-9cbf-e2dca4a3d3d7 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:37.799992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:37.800939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.801434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.801711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.802422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:37.802728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:37.804076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:37.809609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 514/1017] 10.222.0.33 () {56 vars in 1112 bytes} [Thu Jun 2 13:33:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:37.814848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:37.832439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:37.833229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.833515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.833789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.835783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:37.837262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:37.839059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 504/1018] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:37.845640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:37.849361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:37.921760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a44b9-66d3-458c-9fee-0224b15def39 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:37.928089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:37.949082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c02a99-183b-406b-bbb4-5aadbeaea37c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:37.958437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101c2a8-4f58-4280-b0c9-061244f5a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:37.959100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101c2a8-4f58-4280-b0c9-061244f5a20a None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.959388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101c2a8-4f58-4280-b0c9-061244f5a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.959672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101c2a8-4f58-4280-b0c9-061244f5a20a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.960434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101c2a8-4f58-4280-b0c9-061244f5a20a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:37.961804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101c2a8-4f58-4280-b0c9-061244f5a20a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:37.987525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101d6bb-2518-48ea-b38c-5ecffd980b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:37.988176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101d6bb-2518-48ea-b38c-5ecffd980b0b None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:37.988494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101d6bb-2518-48ea-b38c-5ecffd980b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:37.988773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101d6bb-2518-48ea-b38c-5ecffd980b0b None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:37.989467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101d6bb-2518-48ea-b38c-5ecffd980b0b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:37.990891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101d6bb-2518-48ea-b38c-5ecffd980b0b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:38.041992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 515/1019] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:33:38.076427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 505/1020] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:33:37 2022] POST /identity/v3/projects => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:38.955072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c1c5-89ce-466b-8791-01a6ab1abd57 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:38.955616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c1c5-89ce-466b-8791-01a6ab1abd57 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:38.955616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c1c5-89ce-466b-8791-01a6ab1abd57 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:38.957187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 516/1021] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:38.962374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3db6a-fa2c-4b1b-b712-877d796653b4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:38.962798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3db6a-fa2c-4b1b-b712-877d796653b4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:38.962987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3db6a-fa2c-4b1b-b712-877d796653b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:38.980809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3bd3db6a-fa2c-4b1b-b712-877d796653b4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:38.982010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3bd3db6a-fa2c-4b1b-b712-877d796653b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:39.055761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 506/1022] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:39.078415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c1c5-89ce-466b-8791-01a6ab1abd57 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:39.168191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.181843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c1c5-89ce-466b-8791-01a6ab1abd57 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:39.214858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:39.215573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.215863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.216142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] PATH_INFO: `/v3/services/image` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.217440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:39.218806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:39.231596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:39.233438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:39.234292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:39.236571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 517/1023] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jun 2 13:33:39 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:39.239853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3db6a-fa2c-4b1b-b712-877d796653b4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:39.301862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.350011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3db6a-fa2c-4b1b-b712-877d796653b4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:39.389535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:39.390345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.390640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.390920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.391627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:39.391937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:39.393388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:39.398434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 507/1024] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:39.404943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:39.510362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e1acb-3638-406f-b90b-bdd85d733e4a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:39.545998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:39.546651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.546938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.547214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.547907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] RBAC: Adding query filter params (type=image) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:39.548211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:39.549588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:39.559486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 518/1025] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:39.561094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:39.666025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4a4a0-5a70-4026-b7e9-58429ac27fb9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:39.687009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.702064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75edcc-3a9a-44c8-9da8-d90adb847bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:39.703055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75edcc-3a9a-44c8-9da8-d90adb847bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.703055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75edcc-3a9a-44c8-9da8-d90adb847bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.703334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75edcc-3a9a-44c8-9da8-d90adb847bf3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.704128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75edcc-3a9a-44c8-9da8-d90adb847bf3 None admin] RBAC: Adding query filter params (interface=public, service_id=f3efe1125d424c2d8258466565c279b2, region_id=RegionOne) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:39.704471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75edcc-3a9a-44c8-9da8-d90adb847bf3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:39.705845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75edcc-3a9a-44c8-9da8-d90adb847bf3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:39.711097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 508/1026] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:33:39 2022] GET /identity/v3/endpoints?service_id=f3efe1125d424c2d8258466565c279b2&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:39.716517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:39.737166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:39.822632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a091ca7-d0e1-4f64-8180-5e744be68c45 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:39.858231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2d023-2725-4311-8566-240b8e6a3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:39.858908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d023-2725-4311-8566-240b8e6a3e3d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:39.859197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d023-2725-4311-8566-240b8e6a3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:39.859478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2d023-2725-4311-8566-240b8e6a3e3d None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:39.860168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2d023-2725-4311-8566-240b8e6a3e3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:39.861581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2d023-2725-4311-8566-240b8e6a3e3d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:39.868577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 519/1027] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:33:39 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:33:40.398504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed15b26-7b77-43d4-8d29-0259baf4cf48 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.399046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed15b26-7b77-43d4-8d29-0259baf4cf48 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.399046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed15b26-7b77-43d4-8d29-0259baf4cf48 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.400458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 509/1028] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:40.405799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c6e5-7b2b-427d-ac21-5370662b40e2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.406196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c6e5-7b2b-427d-ac21-5370662b40e2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.406375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68c6e5-7b2b-427d-ac21-5370662b40e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.423644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3e68c6e5-7b2b-427d-ac21-5370662b40e2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:40.424848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3e68c6e5-7b2b-427d-ac21-5370662b40e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:40.472751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eecfe-0b1c-424c-ae9e-ce054a670db2 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.473042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eecfe-0b1c-424c-ae9e-ce054a670db2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.473330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469eecfe-0b1c-424c-ae9e-ce054a670db2 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.474709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 510/1029] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:40.480358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7700-1e54-4664-9c54-b2d83f60c7fd None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.480687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7700-1e54-4664-9c54-b2d83f60c7fd None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.480974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7700-1e54-4664-9c54-b2d83f60c7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.503508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 520/1030] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:40.504442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-36cf7700-1e54-4664-9c54-b2d83f60c7fd None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:40.505731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-36cf7700-1e54-4664-9c54-b2d83f60c7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:40.521284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c6e5-7b2b-427d-ac21-5370662b40e2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:40.534572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:40.579054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 511/1031] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:40.602593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7700-1e54-4664-9c54-b2d83f60c7fd None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:40.635606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68c6e5-7b2b-427d-ac21-5370662b40e2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:40.669585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:40.671181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.671466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.671745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.672995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:40.674477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:40.680590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 521/1032] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:40.681573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:40.724686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7700-1e54-4664-9c54-b2d83f60c7fd None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:40.743503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:40.764702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:40.765517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.765799 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.766076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.769926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:40.777296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:40.786183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:40.787191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:40.788134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 512/1033] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 2 13:33:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:40.793114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:40.794506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7ff4b-6154-45f6-a141-e351be37b798 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:40.830348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:40.831020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.831313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.831597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.832330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:40.833799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:40.897854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b8ba3-df0a-4192-8f99-dce563126fc8 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:40.937748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:40.937748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:40.937748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:40.937748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:40.938203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:40.938203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:40.938203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:40.945733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 513/1034] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 2 13:33:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:40.951829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:40.979584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 522/1035] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:33:40 2022] POST /identity/v3/users => generated 285 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:40.989452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:41.063490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ffab-03ae-496f-819a-676849ab3658 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:41.103771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:41.104620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.104907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.105181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.118577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:41.120080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:41.140450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:41.141482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:41.142399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:41.142399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:41.142399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:41.142399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:41.142399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 514/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:41.147607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:41.256084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d077e-f2c1-499a-991e-e58985035850 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:41.290117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:41.290783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.291068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.291347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.292071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:41.292378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:41.293810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:41.295900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:41.307197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 523/1037] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:41.312897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:41.404947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:41.417674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc32af-6e22-46b8-975e-6f724843fee4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:41.453327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:41.454117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.454398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.454667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.462386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:41.463848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:41.478664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:41.479669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:41.481069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:41.482752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 515/1038] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:33:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:41.488584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:41.590250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070417b-9e30-4e5c-8bb4-7f6f3afbd637 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:41.625010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:41.625680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.625962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.626238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.627066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:41.627372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:41.628826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:41.646585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 524/1039] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:33:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:41.651927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:41.754294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de262d9-e0c9-4328-8b5b-404f44e1dd5c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:41.791744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:41.792795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:41.793292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:41.793803 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:41.813770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:41.868224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:41.869746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:41.974715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 516/1040] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:33:41.980552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.035050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:42.081969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeedbd6-0e8c-4d39-b44f-ff639bfef024 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.116752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f922a-3b92-49af-81e2-cc3db2d7dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.117550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f922a-3b92-49af-81e2-cc3db2d7dba1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.117837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f922a-3b92-49af-81e2-cc3db2d7dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.118117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f922a-3b92-49af-81e2-cc3db2d7dba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.129313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f922a-3b92-49af-81e2-cc3db2d7dba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.130699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f922a-3b92-49af-81e2-cc3db2d7dba1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-986f922a-3b92-49af-81e2-cc3db2d7dba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:42.148730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:42.149672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:42.150593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:42.150593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:42.150593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:42.150593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:42.150593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 525/1041] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:42.157607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.210944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2051ff-1213-463d-836b-666ca1f92c1c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.211299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2051ff-1213-463d-836b-666ca1f92c1c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.211512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2051ff-1213-463d-836b-666ca1f92c1c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.212966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 526/1042] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:42.219245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c86d-17fd-4b32-8bbf-8361a66ba5f5 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.219539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c86d-17fd-4b32-8bbf-8361a66ba5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.219824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9c86d-17fd-4b32-8bbf-8361a66ba5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.222460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:42.238590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c7f9c86d-17fd-4b32-8bbf-8361a66ba5f5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:42.239894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c7f9c86d-17fd-4b32-8bbf-8361a66ba5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:42.278598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3a736-a3ff-4183-a270-6b0e3bf4c97d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.307855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 527/1043] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:42.316148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.316871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.317160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.317442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.318164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:42.318475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.319847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.331083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c86d-17fd-4b32-8bbf-8361a66ba5f5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.336823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 517/1044] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:42.337671 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.368892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:42.439929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9c86d-17fd-4b32-8bbf-8361a66ba5f5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.445366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6066d6-8bcc-42d3-996c-a52e399a6244 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.455492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:42.476057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.477171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.477692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.478453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] PATH_INFO: `/v3/services/image` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.479310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.480138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.480977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.481268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.481550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.481878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.491118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.493161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:42.496991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:42.498500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 02 13:33:42.499370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:42.500117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 528/1045] 10.222.0.33 () {56 vars in 1105 bytes} [Thu Jun 2 13:33:42 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:42.505425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:42.520496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:42.521453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:42.522614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:42.524546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 518/1046] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:42.530929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.618682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:42.622545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5152cee-7b08-4bf2-ae93-90402b731a2c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.647325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a4f03f-42a4-4821-b4cb-9660f6644686 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.659920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.660616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.660929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.661185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.661896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] RBAC: Adding query filter params (name=image) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:42.662203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.663554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.668990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 529/1047] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:42.675082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.689394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.690570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.691143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.691822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.693355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:42.693854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.695507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.709692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 519/1048] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:42.715540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.747231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:42.789270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f455b26-e921-4e4b-938c-208b3cb46928 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.823322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da666d5-72f4-4b22-849f-783aeb68f8b3 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:42.826849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.827515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.827798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.828077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.828812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] RBAC: Adding query filter params (type=image) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:42.829120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.830718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.843217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 530/1049] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:42.844211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:42.867186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be8b11-e93a-4bf4-a92c-23aef4ee3169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:42.867852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be8b11-e93a-4bf4-a92c-23aef4ee3169 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:42.868143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be8b11-e93a-4bf4-a92c-23aef4ee3169 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:42.869518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be8b11-e93a-4bf4-a92c-23aef4ee3169 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:42.869518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be8b11-e93a-4bf4-a92c-23aef4ee3169 None admin] RBAC: Adding query filter params (role.id=e09ce114d5de4d539b217bd3bfcd75d6, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b73296e3c73644f29eb0b4960a747c38) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:42.869745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be8b11-e93a-4bf4-a92c-23aef4ee3169 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:42.871060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be8b11-e93a-4bf4-a92c-23aef4ee3169 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:42.875879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:42.876950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 520/1050] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:42 2022] GET /identity/v3/role_assignments?user.id=b73296e3c73644f29eb0b4960a747c38&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=e09ce114d5de4d539b217bd3bfcd75d6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:42.971120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea353-1395-4d0b-a46b-cf8130e01f2f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:43.007688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c6d65-653a-4f46-898a-af1d6312cc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:43.008374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6d65-653a-4f46-898a-af1d6312cc9c None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:43.008685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6d65-653a-4f46-898a-af1d6312cc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:43.008961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c6d65-653a-4f46-898a-af1d6312cc9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:43.009848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c6d65-653a-4f46-898a-af1d6312cc9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:43.011123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c6d65-653a-4f46-898a-af1d6312cc9c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:43.147215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 531/1051] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:33:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:33:43.374171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615cc80-0149-4ec6-a4cf-16dc1a7f8e89 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:43.374384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615cc80-0149-4ec6-a4cf-16dc1a7f8e89 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:43.374672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615cc80-0149-4ec6-a4cf-16dc1a7f8e89 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:43.376315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 521/1052] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:43.381805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf505-cc93-45c6-901d-efa9ee7cee28 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:43.382104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf505-cc93-45c6-901d-efa9ee7cee28 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:43.382391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf505-cc93-45c6-901d-efa9ee7cee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:43.401233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-205bf505-cc93-45c6-901d-efa9ee7cee28 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:43.402422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-205bf505-cc93-45c6-901d-efa9ee7cee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:43.479631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 532/1053] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:43.502941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615cc80-0149-4ec6-a4cf-16dc1a7f8e89 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:43.597566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:43.608209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615cc80-0149-4ec6-a4cf-16dc1a7f8e89 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:43.642593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:43.643307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:43.643591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:43.643867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:43.654849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:43.662779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:43.663749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:43.664647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:43.668982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 522/1054] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:43.671309 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf505-cc93-45c6-901d-efa9ee7cee28 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:43.682477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:43.773013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf505-cc93-45c6-901d-efa9ee7cee28 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:43.807759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:43.808453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:43.808747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:43.809029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:43.809772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:43.810151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:43.811550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:43.819794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 533/1055] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:43.825421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:43.935347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9ed90-8612-44fa-8f81-be33cdc6d228 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:43.969671 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:43.970540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:43.970844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:43.971117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] PATH_INFO: `/v3/users/c9ec9eaf2f32407fb908925b3c495f76` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:43.984901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec9eaf2f32407fb908925b3c495f76)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:43.986353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:43.988228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 523/1056] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:33:43 2022] GET /identity/v3/users/c9ec9eaf2f32407fb908925b3c495f76 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:43.994418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:44.068461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:44.099808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169ca09-e3a9-4027-becc-6b902d0b320b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:44.134289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:44.134940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:44.135229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:44.135509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:44.210156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:44.211695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:44.286619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:44.318165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 534/1057] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:33:44.324126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:44.338167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:44.425836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489608b-a9b7-42b7-ada3-8a93c45d79dd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:44.461856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6dd8f-8ae3-4cca-8ba0-821585e1ee17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:44.462645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6dd8f-8ae3-4cca-8ba0-821585e1ee17 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:44.462932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6dd8f-8ae3-4cca-8ba0-821585e1ee17 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:44.463210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6dd8f-8ae3-4cca-8ba0-821585e1ee17 None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:44.464389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6dd8f-8ae3-4cca-8ba0-821585e1ee17 None admin] RBAC: Authorizing `identity:get_project(project_id=8996cc43424c4ca4a440b67d71e8dfeb)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:44.465864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c6dd8f-8ae3-4cca-8ba0-821585e1ee17 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:44.468148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 524/1058] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:33:44 2022] GET /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:44.474002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:44.587854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244a974-85d0-442d-aec0-b4b95a05deda None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:44.622325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009a378-6bfe-491a-8988-dca94d18af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:44.623660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009a378-6bfe-491a-8988-dca94d18af97 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:44.623947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009a378-6bfe-491a-8988-dca94d18af97 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:44.624226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009a378-6bfe-491a-8988-dca94d18af97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:44.625094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009a378-6bfe-491a-8988-dca94d18af97 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb, user.id=c9ec9eaf2f32407fb908925b3c495f76) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:44.625410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009a378-6bfe-491a-8988-dca94d18af97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:44.626839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009a378-6bfe-491a-8988-dca94d18af97 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:44.632481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 535/1059] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:44 2022] GET /identity/v3/role_assignments?user.id=c9ec9eaf2f32407fb908925b3c495f76&scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:45.186487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68469bbf-4e08-4f2c-984b-7504cd1266b1 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.187008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68469bbf-4e08-4f2c-984b-7504cd1266b1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.187008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68469bbf-4e08-4f2c-984b-7504cd1266b1 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.188468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 525/1060] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:45.193703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c6e5-05fb-485c-aaed-7bb068a9a63e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.194104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c6e5-05fb-485c-aaed-7bb068a9a63e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.194289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5c6e5-05fb-485c-aaed-7bb068a9a63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.210891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f2b5c6e5-05fb-485c-aaed-7bb068a9a63e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:45.218841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f2b5c6e5-05fb-485c-aaed-7bb068a9a63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:45.240600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:45.281184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 536/1061] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:45.304633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68469bbf-4e08-4f2c-984b-7504cd1266b1 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:45.387105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:45.410223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68469bbf-4e08-4f2c-984b-7504cd1266b1 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:45.445687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bda4d6-21e2-4bbb-ae26-9f2130e8a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:45.446549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda4d6-21e2-4bbb-ae26-9f2130e8a6aa None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.446845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda4d6-21e2-4bbb-ae26-9f2130e8a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.447129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bda4d6-21e2-4bbb-ae26-9f2130e8a6aa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.457811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bda4d6-21e2-4bbb-ae26-9f2130e8a6aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-29bda4d6-21e2-4bbb-ae26-9f2130e8a6aa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:45.466114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:45.467475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:45.468343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:45.469645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 526/1062] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:45.473612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c6e5-05fb-485c-aaed-7bb068a9a63e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:45.476715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dd17b-523d-4711-9ffe-19a5cc22a41e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.477010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dd17b-523d-4711-9ffe-19a5cc22a41e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.477288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dd17b-523d-4711-9ffe-19a5cc22a41e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.478863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 527/1063] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:45.484210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11afb-1d6f-4658-a835-7b7a934c61a8 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.484548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11afb-1d6f-4658-a835-7b7a934c61a8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.484810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11afb-1d6f-4658-a835-7b7a934c61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.503616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-1ae11afb-1d6f-4658-a835-7b7a934c61a8 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:45.504849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1ae11afb-1d6f-4658-a835-7b7a934c61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:45.574113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 528/1064] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:45.588940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5c6e5-05fb-485c-aaed-7bb068a9a63e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:45.596068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11afb-1d6f-4658-a835-7b7a934c61a8 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:45.626284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:45.626955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.627243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.627523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.628269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:45.628943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:45.629981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:45.642764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 537/1065] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:45.644717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:45.670037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:45.674263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:45.707753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11afb-1d6f-4658-a835-7b7a934c61a8 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:45.747703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:45.751655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.751655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.751655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.752596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8f778b-e200-4b85-b8cb-87f874f35bcf None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:45.786462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:45.787259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.787543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.787819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.799846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:45.801329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:45.818854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:45.819928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:45.821075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:45.821075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:45.821075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:45.821075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:45.823119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 538/1066] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:45.828461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:45.828899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:45.829936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:45.901892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:45.916822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:45.938652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be008696-6baa-497d-b991-6a86e80027bb None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:45.943859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 529/1067] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:33:45.944742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:45.974194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:45.974867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:45.975151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:45.975427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:45.976171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:45.976511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:45.977873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:45.995131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 539/1068] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:45.996106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.057112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28baf6-c093-4669-9064-9a0b20d99658 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.098960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.099598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991d494-fce3-4d2f-aee8-9ee71dd393cd None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.099775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.100021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.100294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.111817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.113743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:46.132846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:46.133776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:46.134701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:46.134701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:46.134701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:46.134701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:46.136795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.137591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.137882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.138686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.139576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 530/1069] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:46.140350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.146680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.148201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.150444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:46.162914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:46.163982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:46.167208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:46.168201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 540/1070] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:33:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:46.171355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.252263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f22a1ac-3987-49d7-ad8a-d438597d9eab None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.289016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aceb7-4e0f-49c4-a269-2a8b57190460 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.292247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.292947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.293236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.293520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.294248 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:46.294593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.295999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.308346 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 531/1071] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:46.324475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.325168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.325450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.326371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.327418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:46.327733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.329244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.350206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 541/1072] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:33:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:46.356105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.448913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:46.471562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44b88d-a89f-4e17-919a-84fa58e3f84c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.519112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.520319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.520787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.521235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.533280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.534961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:46.553625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:46.554565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:46.555641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:46.555641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:46.555641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:46.555641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:46.555641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 532/1073] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:46.560925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.628462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:46.673695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050959c3-0380-4d86-b4e0-5ae18d8ca93a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.707839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c00778-0199-4314-b683-31765274626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.708529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00778-0199-4314-b683-31765274626b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.708823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00778-0199-4314-b683-31765274626b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.709107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c00778-0199-4314-b683-31765274626b None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.709828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c00778-0199-4314-b683-31765274626b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:46.710137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c00778-0199-4314-b683-31765274626b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.711500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c00778-0199-4314-b683-31765274626b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.722734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 542/1074] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:46.728757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.831420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88c3588-e91a-4538-ab08-afc36b7f2fbe None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:46.860615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:46.865547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bca5a0-4eb6-4ed0-a5c1-65bb0e3c048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:46.866338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bca5a0-4eb6-4ed0-a5c1-65bb0e3c048b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.866628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bca5a0-4eb6-4ed0-a5c1-65bb0e3c048b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.866912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bca5a0-4eb6-4ed0-a5c1-65bb0e3c048b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.873851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bca5a0-4eb6-4ed0-a5c1-65bb0e3c048b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:46.875303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bca5a0-4eb6-4ed0-a5c1-65bb0e3c048b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-80bca5a0-4eb6-4ed0-a5c1-65bb0e3c048b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:46.889941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:46.890987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:46.892031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 533/1075] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:46.897003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c00778-0199-4314-b683-31765274626b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:46.909783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d392-1519-48d0-bc3f-953cb8aa8a19 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.910074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d392-1519-48d0-bc3f-953cb8aa8a19 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.910354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44d392-1519-48d0-bc3f-953cb8aa8a19 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.911717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 534/1076] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:46.916741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c31e-507c-48f5-9b56-e34d8b48510c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:46.917034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c31e-507c-48f5-9b56-e34d8b48510c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:46.917321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3c31e-507c-48f5-9b56-e34d8b48510c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:46.936117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-aaf3c31e-507c-48f5-9b56-e34d8b48510c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:46.937359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-aaf3c31e-507c-48f5-9b56-e34d8b48510c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:47.015064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 535/1077] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:47.018948 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c00778-0199-4314-b683-31765274626b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:47.036378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:47.038234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3c31e-507c-48f5-9b56-e34d8b48510c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:47.056466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:47.057134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:47.057419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:47.057701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:47.058481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:47.058845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:47.060451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:47.073382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 543/1078] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:47.079899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:47.147217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3c31e-507c-48f5-9b56-e34d8b48510c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:47.170897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:47.182409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:47.183220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:47.183534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:47.183808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:47.186052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c3ae8-3a7b-4d37-a818-d91b77c09005 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:47.193963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:47.202329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:47.203344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:47.204723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 536/1079] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:47.211312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:47.221911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:47.222807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:47.223094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:47.223380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b73296e3c73644f29eb0b4960a747c38/roles/e09ce114d5de4d539b217bd3bfcd75d6` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:47.225820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=b73296e3c73644f29eb0b4960a747c38, role_id=e09ce114d5de4d539b217bd3bfcd75d6)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:47.227251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:47.330570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 544/1080] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:33:47 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/b73296e3c73644f29eb0b4960a747c38/roles/e09ce114d5de4d539b217bd3bfcd75d6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:33:47.336603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2670980-2e1e-4165-bc3f-3e5f3ee5e924 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:47.383341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:47.383341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:47.383678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:47.383867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:47.384661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:47.384970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:47.386401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:47.402871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 537/1081] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:47.404110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:47.443879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:47.525513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e1683-3263-4d9e-b0bc-e1e82d867b5f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:47.565970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:47.567077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:47.567964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:47.567964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] PATH_INFO: `/v3/users/c9ec9eaf2f32407fb908925b3c495f76` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:47.569612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec9eaf2f32407fb908925b3c495f76)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:47.573550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:47.573550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 545/1082] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:33:47 2022] GET /identity/v3/users/c9ec9eaf2f32407fb908925b3c495f76 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:47.578574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:47.639536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:47.696114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374643f0-f45f-41af-abac-242381f0f2b7 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:47.733652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772a12e-db22-4e9e-8819-f691dc6c445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:47.734518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772a12e-db22-4e9e-8819-f691dc6c445c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:47.734803 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772a12e-db22-4e9e-8819-f691dc6c445c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:47.735088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772a12e-db22-4e9e-8819-f691dc6c445c None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:47.736302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772a12e-db22-4e9e-8819-f691dc6c445c None admin] RBAC: Authorizing `identity:get_project(project_id=8996cc43424c4ca4a440b67d71e8dfeb)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:47.737791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772a12e-db22-4e9e-8819-f691dc6c445c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:47.739762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 538/1083] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:33:47 2022] GET /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:47.745637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:47.871606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f178aa9-1c69-4f3d-81d4-e5bacffbc3df None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:47.875871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:47.914417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74408cb8-84b2-4598-8d92-696319535054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:47.915602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408cb8-84b2-4598-8d92-696319535054 None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:47.915970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408cb8-84b2-4598-8d92-696319535054 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:47.916494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74408cb8-84b2-4598-8d92-696319535054 None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb/users/c9ec9eaf2f32407fb908925b3c495f76/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:47.918765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74408cb8-84b2-4598-8d92-696319535054 None admin] RBAC: Authorizing `identity:create_grant(project_id=8996cc43424c4ca4a440b67d71e8dfeb, user_id=c9ec9eaf2f32407fb908925b3c495f76, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:47.921362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74408cb8-84b2-4598-8d92-696319535054 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:48.032628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 546/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:33:47 2022] PUT /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb/users/c9ec9eaf2f32407fb908925b3c495f76/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:33:49.632415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2b6ea-4717-4d43-8518-3aeeb761713a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:49.632939 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2b6ea-4717-4d43-8518-3aeeb761713a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:49.633117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2b6ea-4717-4d43-8518-3aeeb761713a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:49.634493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 539/1085] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:49.639809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d8ab-06b3-4735-a9ae-b20e11e7955f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:49.640190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d8ab-06b3-4735-a9ae-b20e11e7955f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:49.640512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73d8ab-06b3-4735-a9ae-b20e11e7955f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:49.657017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-2c73d8ab-06b3-4735-a9ae-b20e11e7955f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:49.658181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2c73d8ab-06b3-4735-a9ae-b20e11e7955f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:49.723503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 547/1086] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:49.747004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2b6ea-4717-4d43-8518-3aeeb761713a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:49.848554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2b6ea-4717-4d43-8518-3aeeb761713a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:49.862045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:49.883216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:49.894706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:49.894706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:49.894706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:49.896826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:49.905115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:49.906253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:49.907133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 540/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Thu Jun 2 13:33:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:33:49.912590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73d8ab-06b3-4735-a9ae-b20e11e7955f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.010270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:50.016990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73d8ab-06b3-4735-a9ae-b20e11e7955f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.050083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.050748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.051038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.051320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.052064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:50.052374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.053898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.062882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 548/1088] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 2 13:33:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:50.068618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.166832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25680-52d3-4fc2-b105-df4f1c0a1657 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.201439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29ca37-0d1a-4efd-ad4e-de8669e8c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.202223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ca37-0d1a-4efd-ad4e-de8669e8c759 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.202510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ca37-0d1a-4efd-ad4e-de8669e8c759 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.202787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29ca37-0d1a-4efd-ad4e-de8669e8c759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.212870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29ca37-0d1a-4efd-ad4e-de8669e8c759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.214317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29ca37-0d1a-4efd-ad4e-de8669e8c759 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-6f29ca37-0d1a-4efd-ad4e-de8669e8c759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:50.233103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:50.234102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:50.235137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:50.235137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:50.235137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:50.235137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:50.235137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 541/1089] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:50.240160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.275070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62628-ce1e-41d4-95f2-9caec5156a05 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.275352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62628-ce1e-41d4-95f2-9caec5156a05 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.275634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c62628-ce1e-41d4-95f2-9caec5156a05 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.277037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 542/1090] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:33:50.282894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3b7ea-fcd3-41b6-8e06-04b4bf6661c1 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.283185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3b7ea-fcd3-41b6-8e06-04b4bf6661c1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.283466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3b7ea-fcd3-41b6-8e06-04b4bf6661c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.300719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4bf3b7ea-fcd3-41b6-8e06-04b4bf6661c1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:50.301918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4bf3b7ea-fcd3-41b6-8e06-04b4bf6661c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:50.319344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:50.360845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff546cd-7c25-4f29-a0d5-9c55a54cec63 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.371831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 543/1091] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:33:50.393889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.394556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.394845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.395128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.395466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3b7ea-fcd3-41b6-8e06-04b4bf6661c1 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.395851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:50.396164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.397575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.410113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 549/1092] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:50.416001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.436981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:50.497612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3b7ea-fcd3-41b6-8e06-04b4bf6661c1 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.518083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c3c66-ac10-464d-96de-6a07a4a12b8e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.533134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.533934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.534221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.534502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.545167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:33:50.552020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:33:50.552730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:50.553686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:33:50.554547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:33:50.555214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.555214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.555214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.555409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 544/1093] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:50.559964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.561744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.563178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.575234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:33:50.578314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:50.579296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:50.580276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 550/1094] 10.222.0.33 () {56 vars in 1093 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:50.585233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.659441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ff089b-6ae0-4fd0-b286-1ba0f468561e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.663177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:50.685197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073463ca-a202-4d15-8a0d-29905c0ef441 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.692470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.693069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.693349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.693622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.694359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:50.694673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.696045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.705249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 545/1095] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:50.711048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.722259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.723718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.724005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.724284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.726433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:50.726433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.727152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.744629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 551/1096] 10.222.0.33 () {56 vars in 1133 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:50.750154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.796629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:50.819170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892a3af-a5a6-4500-96a7-fe7d6d26a0cc None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.852069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf02dc-6f5a-4ca0-ac55-4ad96a6e4243 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:50.854025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.854895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.855181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.855458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] PATH_INFO: `/v3/users/c9ec9eaf2f32407fb908925b3c495f76` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.856701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] RBAC: Authorizing `identity:get_user(user_id=c9ec9eaf2f32407fb908925b3c495f76)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.858454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.860083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 546/1097] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/users/c9ec9eaf2f32407fb908925b3c495f76 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:50.865814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:50.885998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:50.886647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:50.886938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:50.887211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:50.890876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:50.956967 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:50.958608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:50.969165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c2b1d-807c-45a5-ac52-f9c2a0296acf None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.003397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.004068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.004350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.004655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.019447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:51.057950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 552/1098] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:33:51.064261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:51.073624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.075082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.096579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:51.162930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88b9755-76a8-452e-8a7c-f356516ce427 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.177026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 547/1099] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:33:51.183225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:51.201684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.202474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.202760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.203036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.212862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.214241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.228267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:33:51.233275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:51.234261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:51.235160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:33:51.235160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:33:51.235160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:33:51.235160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:51.235160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 553/1100] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:51.240094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:51.283961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75bd88e-7e9c-469e-9f2f-53c9b370965c None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.318676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.319528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.319815 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.320098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.321318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] RBAC: Authorizing `identity:get_project(project_id=8996cc43424c4ca4a440b67d71e8dfeb)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.322059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:51.322854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.324490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 548/1101] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:33:51 2022] GET /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:51.331232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:51.336983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a7cd8-431c-45e1-a599-52d7f2f8b20d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.373862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.375022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.375641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.375924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.376678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:51.376990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.378380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.390077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 554/1102] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:51.395506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:51.429697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ff6ba-3262-45e8-a2d9-8d30b28bdc67 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.442472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:51.463601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.464193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.464509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.464791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.465615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb, user.id=c9ec9eaf2f32407fb908925b3c495f76) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:51.465929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.468021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.474131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 549/1103] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:51 2022] GET /identity/v3/role_assignments?user.id=c9ec9eaf2f32407fb908925b3c495f76&scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:51.497096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4556e8-7688-42eb-92a3-286c1d91e94a None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.534851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.535670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.535961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.536238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.544036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.545584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:33:51.560824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:33:51.561990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:33:51.562953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 555/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:33:51.568290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:51.678967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a360c4a-3881-455c-9fa2-feb655d6a0b2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.713013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b677776-6cd2-487d-9f53-cf4100363b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.713727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677776-6cd2-487d-9f53-cf4100363b71 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.713960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677776-6cd2-487d-9f53-cf4100363b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.714235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b677776-6cd2-487d-9f53-cf4100363b71 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.715034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677776-6cd2-487d-9f53-cf4100363b71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:51.715349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677776-6cd2-487d-9f53-cf4100363b71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.717411 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b677776-6cd2-487d-9f53-cf4100363b71 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.729922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 550/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:33:51.736377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:51.745209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:51.835006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68d35-543d-4ec6-91e1-90c21b7ef67d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:51.868263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d2d5d-2bdc-4ce8-859f-60f859437068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:51.868963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d2d5d-2bdc-4ce8-859f-60f859437068 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:51.869254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d2d5d-2bdc-4ce8-859f-60f859437068 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:51.869538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d2d5d-2bdc-4ce8-859f-60f859437068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:51.870369 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d2d5d-2bdc-4ce8-859f-60f859437068 None admin] RBAC: Adding query filter params (role.id=e09ce114d5de4d539b217bd3bfcd75d6, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=b73296e3c73644f29eb0b4960a747c38) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:51.870690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d2d5d-2bdc-4ce8-859f-60f859437068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:51.872119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682d2d5d-2bdc-4ce8-859f-60f859437068 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:51.879295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 556/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:51 2022] GET /identity/v3/role_assignments?user.id=b73296e3c73644f29eb0b4960a747c38&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=e09ce114d5de4d539b217bd3bfcd75d6 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:53.743276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdfeed-be92-4f9d-87ad-d34d62efe505 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:53.743830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdfeed-be92-4f9d-87ad-d34d62efe505 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:53.743830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cdfeed-be92-4f9d-87ad-d34d62efe505 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:53.745324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 551/1107] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:53.751203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83903306-da65-401c-a702-0006ccb3903c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:53.751601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83903306-da65-401c-a702-0006ccb3903c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:53.751703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83903306-da65-401c-a702-0006ccb3903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:53.768098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-83903306-da65-401c-a702-0006ccb3903c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:53.769301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-83903306-da65-401c-a702-0006ccb3903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:53.828410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:53.832803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 557/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:53.857889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdfeed-be92-4f9d-87ad-d34d62efe505 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:53.893520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:53.963338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cdfeed-be92-4f9d-87ad-d34d62efe505 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:54.004686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e72248-98c5-4c8a-8df8-a3fb025d45f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:54.005400 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e72248-98c5-4c8a-8df8-a3fb025d45f7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:54.005690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e72248-98c5-4c8a-8df8-a3fb025d45f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:54.005971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e72248-98c5-4c8a-8df8-a3fb025d45f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:54.007145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e72248-98c5-4c8a-8df8-a3fb025d45f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:54.008620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e72248-98c5-4c8a-8df8-a3fb025d45f7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:54.010228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 552/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:33:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:54.016174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83903306-da65-401c-a702-0006ccb3903c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:54.111381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83903306-da65-401c-a702-0006ccb3903c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:54.143456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df61a2-398d-4885-8c39-7e34b3e79f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:54.144111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df61a2-398d-4885-8c39-7e34b3e79f30 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:54.144396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df61a2-398d-4885-8c39-7e34b3e79f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:54.144700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df61a2-398d-4885-8c39-7e34b3e79f30 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:54.145394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df61a2-398d-4885-8c39-7e34b3e79f30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:54.146798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df61a2-398d-4885-8c39-7e34b3e79f30 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:54.259821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 558/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:33:54 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:33:56.521923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb57e73-c4ae-4fb0-9495-86e78c03b15d None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:56.522397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb57e73-c4ae-4fb0-9495-86e78c03b15d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:56.522506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb57e73-c4ae-4fb0-9495-86e78c03b15d None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:56.523848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 553/1111] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:56.529099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76bfc-e0b0-405a-bcb2-9c019cd3f486 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:56.529537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76bfc-e0b0-405a-bcb2-9c019cd3f486 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:56.529657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76bfc-e0b0-405a-bcb2-9c019cd3f486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:56.545991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-07d76bfc-e0b0-405a-bcb2-9c019cd3f486 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:56.547158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-07d76bfc-e0b0-405a-bcb2-9c019cd3f486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:56.595595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:56.612646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 559/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:56.636848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb57e73-c4ae-4fb0-9495-86e78c03b15d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:56.735828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb57e73-c4ae-4fb0-9495-86e78c03b15d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:56.738132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:56.768378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:56.769168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:56.769454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:56.769732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] PATH_INFO: `/v3/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:56.771274 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] RBAC: Authorizing `identity:get_role(role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:56.772665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:56.773997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 554/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:33:56 2022] GET /identity/v3/roles/6fcb971d81654e48875c8cd12e298a9e => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:56.779882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d76bfc-e0b0-405a-bcb2-9c019cd3f486 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:56.879674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d76bfc-e0b0-405a-bcb2-9c019cd3f486 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:56.912004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:56.912889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:56.913178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:56.913460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] PATH_INFO: `/v3/users/a58b6f2f56c14aada993b061b1db418f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:56.926818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] RBAC: Authorizing `identity:get_user(user_id=a58b6f2f56c14aada993b061b1db418f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:56.928265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:56.929942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 560/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:33:56 2022] GET /identity/v3/users/a58b6f2f56c14aada993b061b1db418f => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:56.936360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:57.034767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118fa64-0baa-4aec-ae84-3d89ec22529d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:57.068503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:57.069139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:57.069425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:57.069704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:57.109664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:57.134463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:57.135912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:57.233073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 555/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:33:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:33:57.239032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:57.283762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:57.343219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12faf5-8845-4463-bde6-ff5c0fe118a5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:57.376288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937cb84a-cae9-4895-bc44-da30c3478002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:57.377178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cb84a-cae9-4895-bc44-da30c3478002 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:57.377461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cb84a-cae9-4895-bc44-da30c3478002 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:57.377741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937cb84a-cae9-4895-bc44-da30c3478002 None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:57.378982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cb84a-cae9-4895-bc44-da30c3478002 None admin] RBAC: Authorizing `identity:get_project(project_id=8996cc43424c4ca4a440b67d71e8dfeb)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:57.380450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937cb84a-cae9-4895-bc44-da30c3478002 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:57.382137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 561/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:33:57 2022] GET /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:57.389060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:57.458408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:33:57.488190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf39d5-5bc7-4e55-bb24-940d3d50e4aa None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:33:57.522249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2592-9646-4bca-bf6f-e627e5759dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:33:57.522901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2592-9646-4bca-bf6f-e627e5759dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:57.523197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2592-9646-4bca-bf6f-e627e5759dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:57.523494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2592-9646-4bca-bf6f-e627e5759dc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:57.524377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2592-9646-4bca-bf6f-e627e5759dc5 None admin] RBAC: Adding query filter params (role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb, user.id=a58b6f2f56c14aada993b061b1db418f) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:33:57.524721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2592-9646-4bca-bf6f-e627e5759dc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:33:57.526177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2592-9646-4bca-bf6f-e627e5759dc5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:33:57.532502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 556/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:33:57 2022] GET /identity/v3/role_assignments?user.id=a58b6f2f56c14aada993b061b1db418f&scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:33:59.770675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6d2f-1cc0-4e8d-933a-7cf0ff7f8d4c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:59.771180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6d2f-1cc0-4e8d-933a-7cf0ff7f8d4c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:59.771180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b6d2f-1cc0-4e8d-933a-7cf0ff7f8d4c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:59.772549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 562/1118] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:33:59.777630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7fc3-5678-479f-ba67-018965d9d211 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:33:59.778034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7fc3-5678-479f-ba67-018965d9d211 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:33:59.778193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea7fc3-5678-479f-ba67-018965d9d211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:33:59.795215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-63ea7fc3-5678-479f-ba67-018965d9d211 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:33:59.796432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-63ea7fc3-5678-479f-ba67-018965d9d211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:33:59.860996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 557/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:33:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:33:59.883634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6d2f-1cc0-4e8d-933a-7cf0ff7f8d4c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:33:59.991851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b6d2f-1cc0-4e8d-933a-7cf0ff7f8d4c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:00.006649 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:00.027621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:00.028637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:00.028936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:00.029216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] PATH_INFO: `/v3/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:00.030771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] RBAC: Authorizing `identity:get_role(role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:00.032132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:00.033546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 563/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:33:59 2022] GET /identity/v3/roles/6fcb971d81654e48875c8cd12e298a9e => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:00.039397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea7fc3-5678-479f-ba67-018965d9d211 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:00.102579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:00.136731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea7fc3-5678-479f-ba67-018965d9d211 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:00.170088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:00.170930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:00.171221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:00.171502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] PATH_INFO: `/v3/users/a58b6f2f56c14aada993b061b1db418f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:00.172724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] RBAC: Authorizing `identity:get_user(user_id=a58b6f2f56c14aada993b061b1db418f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:00.174162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:00.175776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 558/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:00 2022] GET /identity/v3/users/a58b6f2f56c14aada993b061b1db418f => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:00.181505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:00.278563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c22a5-9549-4304-bb88-57fba631abd9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:00.315596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ab89-d8b6-403c-9c12-83c56b0bc6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:00.316466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ab89-d8b6-403c-9c12-83c56b0bc6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:00.316760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ab89-d8b6-403c-9c12-83c56b0bc6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:00.317042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ab89-d8b6-403c-9c12-83c56b0bc6d3 None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:00.318233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ab89-d8b6-403c-9c12-83c56b0bc6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=8996cc43424c4ca4a440b67d71e8dfeb)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:00.319663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ab89-d8b6-403c-9c12-83c56b0bc6d3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:00.321402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 564/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:00 2022] GET /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:00.327975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:00.424897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31ba50-293e-4225-9a12-a81a475dbc74 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:00.458667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5680a-8252-4f98-90c8-2c276df0d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:00.459539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5680a-8252-4f98-90c8-2c276df0d224 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:00.459825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5680a-8252-4f98-90c8-2c276df0d224 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:00.460105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5680a-8252-4f98-90c8-2c276df0d224 None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb/users/a58b6f2f56c14aada993b061b1db418f/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:00.462306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5680a-8252-4f98-90c8-2c276df0d224 None admin] RBAC: Authorizing `identity:create_grant(project_id=8996cc43424c4ca4a440b67d71e8dfeb, user_id=a58b6f2f56c14aada993b061b1db418f, role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:00.463757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5680a-8252-4f98-90c8-2c276df0d224 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:00.465926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:00.573423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 559/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:00 2022] PUT /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb/users/a58b6f2f56c14aada993b061b1db418f/roles/6fcb971d81654e48875c8cd12e298a9e => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:02.802191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88250a-4788-4513-82a6-0e495777c09a None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:02.802689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88250a-4788-4513-82a6-0e495777c09a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:02.802689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88250a-4788-4513-82a6-0e495777c09a None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:02.804030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 565/1124] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:02.809098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078496-7197-4ccd-86cc-01e50dc54eb2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:02.810209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078496-7197-4ccd-86cc-01e50dc54eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:02.810209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7078496-7197-4ccd-86cc-01e50dc54eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:02.827173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d7078496-7197-4ccd-86cc-01e50dc54eb2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:02.828333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d7078496-7197-4ccd-86cc-01e50dc54eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:02.892547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 560/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:02.915835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88250a-4788-4513-82a6-0e495777c09a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:02.967430 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:03.025625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88250a-4788-4513-82a6-0e495777c09a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:03.059007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:03.059833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:03.060115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:03.060394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] PATH_INFO: `/v3/roles/6fcb971d81654e48875c8cd12e298a9e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:03.061881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] RBAC: Authorizing `identity:get_role(role_id=6fcb971d81654e48875c8cd12e298a9e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:03.063242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:03.064668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 566/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:02 2022] GET /identity/v3/roles/6fcb971d81654e48875c8cd12e298a9e => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:03.070468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7078496-7197-4ccd-86cc-01e50dc54eb2 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:03.165531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7078496-7197-4ccd-86cc-01e50dc54eb2 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:03.188226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:03.198245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:03.199414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:03.199414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:03.199653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] PATH_INFO: `/v3/users/a58b6f2f56c14aada993b061b1db418f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:03.201182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] RBAC: Authorizing `identity:get_user(user_id=a58b6f2f56c14aada993b061b1db418f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:03.202630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:03.204224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 561/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:03 2022] GET /identity/v3/users/a58b6f2f56c14aada993b061b1db418f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:03.209924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:03.308254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17e32a-f387-4056-b539-1e6050dc3eb4 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:03.324835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:03.342883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:03.343546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:03.343829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:03.344105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:03.410174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:03.411628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:03.508975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 567/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:03.515452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:03.612136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c95ea-08cc-43c9-8167-3bee377fa087 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:03.645013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef84c4a-4139-4c43-92f1-97c635d511dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:03.645856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84c4a-4139-4c43-92f1-97c635d511dc None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:03.646144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84c4a-4139-4c43-92f1-97c635d511dc None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:03.646425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef84c4a-4139-4c43-92f1-97c635d511dc None admin] PATH_INFO: `/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:03.647594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84c4a-4139-4c43-92f1-97c635d511dc None admin] RBAC: Authorizing `identity:get_project(project_id=8996cc43424c4ca4a440b67d71e8dfeb)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:03.649067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef84c4a-4139-4c43-92f1-97c635d511dc None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:03.650724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 562/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:03 2022] GET /identity/v3/projects/8996cc43424c4ca4a440b67d71e8dfeb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:03.657420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:03.674239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:03.759517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1783-ca33-4a56-9b8f-fa3e41f99e28 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:03.792225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204bec2-48c3-4ecf-b7c4-fc7a655dd8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:03.792904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bec2-48c3-4ecf-b7c4-fc7a655dd8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:03.793192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bec2-48c3-4ecf-b7c4-fc7a655dd8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:03.793470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204bec2-48c3-4ecf-b7c4-fc7a655dd8f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:03.794523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204bec2-48c3-4ecf-b7c4-fc7a655dd8f4 None admin] RBAC: Adding query filter params (role.id=6fcb971d81654e48875c8cd12e298a9e, scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb, user.id=a58b6f2f56c14aada993b061b1db418f) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:03.794840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204bec2-48c3-4ecf-b7c4-fc7a655dd8f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:03.796264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204bec2-48c3-4ecf-b7c4-fc7a655dd8f4 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:03.801957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 568/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:03 2022] GET /identity/v3/role_assignments?user.id=a58b6f2f56c14aada993b061b1db418f&scope.project.id=8996cc43424c4ca4a440b67d71e8dfeb&role.id=6fcb971d81654e48875c8cd12e298a9e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:06.064338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b961-973d-44bf-83f9-11e866a7da22 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:06.065040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b961-973d-44bf-83f9-11e866a7da22 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:06.065040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b961-973d-44bf-83f9-11e866a7da22 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:06.066295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 563/1131] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:06.071505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443112c-56fb-400c-8df0-9279dd9d5be5 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:06.071894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443112c-56fb-400c-8df0-9279dd9d5be5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:06.072063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443112c-56fb-400c-8df0-9279dd9d5be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:06.089163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1443112c-56fb-400c-8df0-9279dd9d5be5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:06.090366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1443112c-56fb-400c-8df0-9279dd9d5be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:06.155792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 569/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:06.179235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b961-973d-44bf-83f9-11e866a7da22 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:06.239735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:06.279717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b961-973d-44bf-83f9-11e866a7da22 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:06.313068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1dd38-29ad-4bef-8c8b-e34f24d6370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:06.313850 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1dd38-29ad-4bef-8c8b-e34f24d6370d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:06.314139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1dd38-29ad-4bef-8c8b-e34f24d6370d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:06.314468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1dd38-29ad-4bef-8c8b-e34f24d6370d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:06.315586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1dd38-29ad-4bef-8c8b-e34f24d6370d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:06.317067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1dd38-29ad-4bef-8c8b-e34f24d6370d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:06.318656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 564/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:06.324424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443112c-56fb-400c-8df0-9279dd9d5be5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:06.336384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:06.420620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443112c-56fb-400c-8df0-9279dd9d5be5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:06.453447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3390a03-c858-47a6-9af6-376b656e4a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:06.454096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390a03-c858-47a6-9af6-376b656e4a61 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:06.454387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390a03-c858-47a6-9af6-376b656e4a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:06.454669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3390a03-c858-47a6-9af6-376b656e4a61 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:06.455383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3390a03-c858-47a6-9af6-376b656e4a61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:06.456848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3390a03-c858-47a6-9af6-376b656e4a61 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:06.655424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 570/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:34:06 2022] POST /identity/v3/projects => generated 311 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:08.909750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a6b45-e4b3-41f6-883c-4d5f1f785392 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:08.910288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a6b45-e4b3-41f6-883c-4d5f1f785392 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:08.910288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139a6b45-e4b3-41f6-883c-4d5f1f785392 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:08.911566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 565/1135] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:08.916749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8fae6-f5b0-42e0-826a-1b5b61302df4 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:08.917184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8fae6-f5b0-42e0-826a-1b5b61302df4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:08.917294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8fae6-f5b0-42e0-826a-1b5b61302df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:08.935004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-33e8fae6-f5b0-42e0-826a-1b5b61302df4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:08.936326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-33e8fae6-f5b0-42e0-826a-1b5b61302df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:08.991951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:09.002521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 571/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:09.027591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a6b45-e4b3-41f6-883c-4d5f1f785392 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:09.127382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139a6b45-e4b3-41f6-883c-4d5f1f785392 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:09.152131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:09.167240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b080c34-bf5c-44d9-9002-40262f8c2063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:09.167240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080c34-bf5c-44d9-9002-40262f8c2063 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:09.167240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080c34-bf5c-44d9-9002-40262f8c2063 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:09.167240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b080c34-bf5c-44d9-9002-40262f8c2063 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:09.167784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080c34-bf5c-44d9-9002-40262f8c2063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:09.167784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b080c34-bf5c-44d9-9002-40262f8c2063 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:09.167784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 566/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:34:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:09.171571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8fae6-f5b0-42e0-826a-1b5b61302df4 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:09.269593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8fae6-f5b0-42e0-826a-1b5b61302df4 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:09.306158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f524d79-8611-40bb-961a-c2da73647470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:09.306822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524d79-8611-40bb-961a-c2da73647470 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:09.307124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524d79-8611-40bb-961a-c2da73647470 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:09.307406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524d79-8611-40bb-961a-c2da73647470 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:09.308129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f524d79-8611-40bb-961a-c2da73647470 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:09.310172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f524d79-8611-40bb-961a-c2da73647470 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:09.401662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 572/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:34:09 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:34:11.676950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249ef5-53a2-42b9-b4bc-381647b9cf32 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:11.677493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249ef5-53a2-42b9-b4bc-381647b9cf32 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:11.677493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18249ef5-53a2-42b9-b4bc-381647b9cf32 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:11.678869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 567/1139] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:11.684817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4866-7360-401f-9300-0f332f76ea2a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:11.685686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4866-7360-401f-9300-0f332f76ea2a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:11.685686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4866-7360-401f-9300-0f332f76ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:11.703220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9d1f4866-7360-401f-9300-0f332f76ea2a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:11.704426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9d1f4866-7360-401f-9300-0f332f76ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:11.748101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:11.770720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 573/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:11.794824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249ef5-53a2-42b9-b4bc-381647b9cf32 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:11.893756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18249ef5-53a2-42b9-b4bc-381647b9cf32 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:11.925876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:11.926645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:11.926928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:11.927203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:11.937630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:11.945101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:11.946294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:34:11.947418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 568/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:11.952518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4866-7360-401f-9300-0f332f76ea2a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:12.049196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4866-7360-401f-9300-0f332f76ea2a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:12.087646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:12.088306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:12.088623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:12.088906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:12.089650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:12.089961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:12.092063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:12.099918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 574/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:12.106570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:12.161937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:12.204101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e60906-fdec-41ff-bacb-0f6bdcf64157 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:12.237124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:12.237980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:12.238261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:12.238533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] PATH_INFO: `/v3/users/692f86e5fe704a7da5268d7face6eb78` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:12.251206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] RBAC: Authorizing `identity:get_user(user_id=692f86e5fe704a7da5268d7face6eb78)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:12.258203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:12.258203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 569/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:12 2022] GET /identity/v3/users/692f86e5fe704a7da5268d7face6eb78 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:12.260123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:12.302144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:12.358302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8415-a407-4e92-9c60-3487deac7047 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:12.390467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:12.391105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:12.391396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:12.391679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:12.456766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:12.458202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:12.498458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:12.555474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 575/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:12.561861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:12.659426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf3068-e8ca-4adb-a0d3-3fec6224e615 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:12.673823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:12.693298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c86b5-2daa-4d3c-804b-4cfb3cb6d546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:12.694143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c86b5-2daa-4d3c-804b-4cfb3cb6d546 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:12.694429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c86b5-2daa-4d3c-804b-4cfb3cb6d546 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:12.694706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c86b5-2daa-4d3c-804b-4cfb3cb6d546 None admin] PATH_INFO: `/v3/projects/19587c6497b2417281a8af77d588318b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:12.695883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c86b5-2daa-4d3c-804b-4cfb3cb6d546 None admin] RBAC: Authorizing `identity:get_project(project_id=19587c6497b2417281a8af77d588318b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:12.697367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c86b5-2daa-4d3c-804b-4cfb3cb6d546 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:12.699033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 570/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:12 2022] GET /identity/v3/projects/19587c6497b2417281a8af77d588318b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:12.705764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:12.802886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151bae5-3181-451f-ba17-1b0d904795b5 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:12.836556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68eed46-97c8-4ac5-b703-29a7c2e23f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:12.837137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eed46-97c8-4ac5-b703-29a7c2e23f47 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:12.837419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eed46-97c8-4ac5-b703-29a7c2e23f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:12.837694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68eed46-97c8-4ac5-b703-29a7c2e23f47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:12.838511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eed46-97c8-4ac5-b703-29a7c2e23f47 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=19587c6497b2417281a8af77d588318b, user.id=692f86e5fe704a7da5268d7face6eb78) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:12.838822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eed46-97c8-4ac5-b703-29a7c2e23f47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:12.840289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68eed46-97c8-4ac5-b703-29a7c2e23f47 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:12.845702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 576/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:12 2022] GET /identity/v3/role_assignments?user.id=692f86e5fe704a7da5268d7face6eb78&scope.project.id=19587c6497b2417281a8af77d588318b&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:15.099941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554dfe8-9e73-4a22-81b3-6b21b45fb1e3 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:15.100498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554dfe8-9e73-4a22-81b3-6b21b45fb1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:15.100620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554dfe8-9e73-4a22-81b3-6b21b45fb1e3 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:15.101927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 571/1147] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:15.107502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22266c56-7b51-469b-973c-3d4523c89bca None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:15.107900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22266c56-7b51-469b-973c-3d4523c89bca None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:15.108066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22266c56-7b51-469b-973c-3d4523c89bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:15.114019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:15.125602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-22266c56-7b51-469b-973c-3d4523c89bca None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:15.126449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-22266c56-7b51-469b-973c-3d4523c89bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:15.196863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 577/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:15.220157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554dfe8-9e73-4a22-81b3-6b21b45fb1e3 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:15.318616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554dfe8-9e73-4a22-81b3-6b21b45fb1e3 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:15.352896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:15.354768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:15.354768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:15.354768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:15.369109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:15.377348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:15.378497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:34:15.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 572/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:15.385072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22266c56-7b51-469b-973c-3d4523c89bca None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:15.479052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22266c56-7b51-469b-973c-3d4523c89bca None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:15.512637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:15.513297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:15.513578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:15.513852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:15.514587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:15.514894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:15.516245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:15.517583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:15.524596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 578/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:15.530509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:15.573692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:15.629600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e3499-4cc2-43ec-8a14-1c9f2aa59a3b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:15.669498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:15.670447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:15.670736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:15.671012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] PATH_INFO: `/v3/users/692f86e5fe704a7da5268d7face6eb78` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:15.672282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] RBAC: Authorizing `identity:get_user(user_id=692f86e5fe704a7da5268d7face6eb78)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:15.673788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:15.680395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 573/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:15 2022] GET /identity/v3/users/692f86e5fe704a7da5268d7face6eb78 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:15.682491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:15.788279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a83ac-1b97-40aa-b7ff-23d14e671cdb None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:15.822539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b68b74-2c47-487a-bb6b-69609e78b2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:15.823402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b68b74-2c47-487a-bb6b-69609e78b2ea None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:15.823690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b68b74-2c47-487a-bb6b-69609e78b2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:15.823970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b68b74-2c47-487a-bb6b-69609e78b2ea None admin] PATH_INFO: `/v3/projects/19587c6497b2417281a8af77d588318b` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:15.825217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b68b74-2c47-487a-bb6b-69609e78b2ea None admin] RBAC: Authorizing `identity:get_project(project_id=19587c6497b2417281a8af77d588318b)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:15.826643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b68b74-2c47-487a-bb6b-69609e78b2ea None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:15.828351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 579/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:15 2022] GET /identity/v3/projects/19587c6497b2417281a8af77d588318b => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:15.834309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:15.934819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ed374-c68b-41d4-88ce-2a9dee682f1f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:15.944692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:15.968054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146e2e0-1c8b-42a4-bc78-5e2e10341d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:15.968965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146e2e0-1c8b-42a4-bc78-5e2e10341d1b None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:15.969252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146e2e0-1c8b-42a4-bc78-5e2e10341d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:15.969527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146e2e0-1c8b-42a4-bc78-5e2e10341d1b None admin] PATH_INFO: `/v3/projects/19587c6497b2417281a8af77d588318b/users/692f86e5fe704a7da5268d7face6eb78/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:15.971569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146e2e0-1c8b-42a4-bc78-5e2e10341d1b None admin] RBAC: Authorizing `identity:create_grant(project_id=19587c6497b2417281a8af77d588318b, user_id=692f86e5fe704a7da5268d7face6eb78, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:15.973073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5146e2e0-1c8b-42a4-bc78-5e2e10341d1b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:16.069821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 574/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:15 2022] PUT /identity/v3/projects/19587c6497b2417281a8af77d588318b/users/692f86e5fe704a7da5268d7face6eb78/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:34:18.324094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50462-42d9-47a6-aaa8-e5baafd7601b None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:18.324687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50462-42d9-47a6-aaa8-e5baafd7601b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:18.324859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50462-42d9-47a6-aaa8-e5baafd7601b None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:18.326190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 580/1154] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:18.331431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc826ac3-0673-4cae-bbf0-2f119f5cf660 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:18.331858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc826ac3-0673-4cae-bbf0-2f119f5cf660 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:18.332007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc826ac3-0673-4cae-bbf0-2f119f5cf660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:18.349468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-fc826ac3-0673-4cae-bbf0-2f119f5cf660 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:18.350650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-fc826ac3-0673-4cae-bbf0-2f119f5cf660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:18.427054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 575/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:18.450921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50462-42d9-47a6-aaa8-e5baafd7601b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:18.513956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:18.551588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50462-42d9-47a6-aaa8-e5baafd7601b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:18.584110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:18.585042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:18.585334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:18.585616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:18.595614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:18.603447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:18.604593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:34:18.605645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 581/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:18.611232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc826ac3-0673-4cae-bbf0-2f119f5cf660 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:18.707655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:18.710573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc826ac3-0673-4cae-bbf0-2f119f5cf660 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:18.745171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:18.745828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:18.746116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:18.747259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:18.747669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:18.747977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:18.749384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:18.757175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 576/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:18.763916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:18.860140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f981a52-4623-4fd3-83a9-9a6122ca7b33 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:18.882475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:18.892808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:18.896722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:18.896722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:18.896722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] PATH_INFO: `/v3/users/692f86e5fe704a7da5268d7face6eb78` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:18.896722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] RBAC: Authorizing `identity:get_user(user_id=692f86e5fe704a7da5268d7face6eb78)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:18.897079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:18.898510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 582/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:18 2022] GET /identity/v3/users/692f86e5fe704a7da5268d7face6eb78 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:18.904813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:19.002395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa470d6d-d1f9-4989-ba79-ac3b286b4abe None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:19.034866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:19.035512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.035799 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.036082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.066832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:19.104362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:19.105940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:19.202039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 577/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:19.208042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:19.305929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9772037d-2424-4455-abe5-ebb76d971548 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:19.338420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06928fc-3273-469a-bcd5-f7deeefd6801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:19.339477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06928fc-3273-469a-bcd5-f7deeefd6801 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.339944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06928fc-3273-469a-bcd5-f7deeefd6801 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.340557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06928fc-3273-469a-bcd5-f7deeefd6801 None admin] PATH_INFO: `/v3/projects/19587c6497b2417281a8af77d588318b` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.342608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06928fc-3273-469a-bcd5-f7deeefd6801 None admin] RBAC: Authorizing `identity:get_project(project_id=19587c6497b2417281a8af77d588318b)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:19.345218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06928fc-3273-469a-bcd5-f7deeefd6801 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:19.348191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 583/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:19 2022] GET /identity/v3/projects/19587c6497b2417281a8af77d588318b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:19.354453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:19.414460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:19.451769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2673a6c-dcf9-4887-b147-92607309ade7 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:19.486144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395f69f3-72c5-4406-a283-5a5652c7ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:19.486736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f69f3-72c5-4406-a283-5a5652c7ccaf None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:19.487022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f69f3-72c5-4406-a283-5a5652c7ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:19.487300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395f69f3-72c5-4406-a283-5a5652c7ccaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:19.488132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f69f3-72c5-4406-a283-5a5652c7ccaf None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=19587c6497b2417281a8af77d588318b, user.id=692f86e5fe704a7da5268d7face6eb78) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:19.488479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f69f3-72c5-4406-a283-5a5652c7ccaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:19.489917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395f69f3-72c5-4406-a283-5a5652c7ccaf None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:19.495764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 578/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:19 2022] GET /identity/v3/role_assignments?user.id=692f86e5fe704a7da5268d7face6eb78&scope.project.id=19587c6497b2417281a8af77d588318b&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:21.752878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a1a7f-0ddc-4f6f-85f7-4bc9f52f5a13 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:21.753373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a1a7f-0ddc-4f6f-85f7-4bc9f52f5a13 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:21.753373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a1a7f-0ddc-4f6f-85f7-4bc9f52f5a13 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:21.754731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 584/1162] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:21.759945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328241b-49bd-4499-886f-91e6f9552510 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:21.760312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328241b-49bd-4499-886f-91e6f9552510 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:21.760556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328241b-49bd-4499-886f-91e6f9552510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:21.777802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4328241b-49bd-4499-886f-91e6f9552510 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:21.779052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4328241b-49bd-4499-886f-91e6f9552510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:21.843493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 579/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:21.865571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a1a7f-0ddc-4f6f-85f7-4bc9f52f5a13 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:21.925253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:21.966766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a1a7f-0ddc-4f6f-85f7-4bc9f52f5a13 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:21.999399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:22.000068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:22.000352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:22.000651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:22.065831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:22.067213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:22.123672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:22.162773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 585/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:22.169203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328241b-49bd-4499-886f-91e6f9552510 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:22.223856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:22.266763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328241b-49bd-4499-886f-91e6f9552510 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:22.299777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a0b86-1816-45bb-b9a2-93a5ed2bb148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:22.300591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0b86-1816-45bb-b9a2-93a5ed2bb148 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:22.300881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0b86-1816-45bb-b9a2-93a5ed2bb148 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:22.301161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0b86-1816-45bb-b9a2-93a5ed2bb148 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:22.307701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a0b86-1816-45bb-b9a2-93a5ed2bb148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:22.309899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a0b86-1816-45bb-b9a2-93a5ed2bb148 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-084a0b86-1816-45bb-b9a2-93a5ed2bb148 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:22.323837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:22.325379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:34:22.326511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 580/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:34:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:22.331044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:22.430653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67558b2-233e-4456-bc0e-a23b25bf68ea None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:22.463089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc305b1d-fb20-4856-8d7b-64abe16cc537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:22.463758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305b1d-fb20-4856-8d7b-64abe16cc537 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:22.464044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305b1d-fb20-4856-8d7b-64abe16cc537 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:22.464320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc305b1d-fb20-4856-8d7b-64abe16cc537 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:22.465586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc305b1d-fb20-4856-8d7b-64abe16cc537 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:22.465888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc305b1d-fb20-4856-8d7b-64abe16cc537 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:22.467392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc305b1d-fb20-4856-8d7b-64abe16cc537 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:22.474683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 586/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Thu Jun 2 13:34:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:24.682600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367682-36b5-4e64-a0a8-0e208ae694bb None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:24.683126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367682-36b5-4e64-a0a8-0e208ae694bb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:24.683126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367682-36b5-4e64-a0a8-0e208ae694bb None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:24.685638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 581/1167] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:24.691388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805322-6c38-40df-a63c-ff3e7b78e567 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:24.691854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805322-6c38-40df-a63c-ff3e7b78e567 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:24.691963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10805322-6c38-40df-a63c-ff3e7b78e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:24.708902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-10805322-6c38-40df-a63c-ff3e7b78e567 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:24.710094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-10805322-6c38-40df-a63c-ff3e7b78e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:24.728073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:24.777169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 587/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:24.801169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af367682-36b5-4e64-a0a8-0e208ae694bb None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:24.900341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af367682-36b5-4e64-a0a8-0e208ae694bb None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:24.916240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:24.933342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72ad96-caa3-4f32-a189-0f3554f28a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:24.934512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ad96-caa3-4f32-a189-0f3554f28a56 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:24.934767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ad96-caa3-4f32-a189-0f3554f28a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:24.935040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72ad96-caa3-4f32-a189-0f3554f28a56 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:24.935772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72ad96-caa3-4f32-a189-0f3554f28a56 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:24.937190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72ad96-caa3-4f32-a189-0f3554f28a56 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:25.031044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 582/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Thu Jun 2 13:34:24 2022] POST /identity/v3/domains => generated 267 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:27.283319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd323b-02fd-4e17-8d26-8f62af92be9e None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:27.283870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd323b-02fd-4e17-8d26-8f62af92be9e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:27.283870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd323b-02fd-4e17-8d26-8f62af92be9e None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:27.285267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 588/1170] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:27.290417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81b6b-6149-4dce-bddb-d5a22da85ce4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:27.290855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81b6b-6149-4dce-bddb-d5a22da85ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:27.290987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81b6b-6149-4dce-bddb-d5a22da85ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:27.307668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-40f81b6b-6149-4dce-bddb-d5a22da85ce4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:27.309568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-40f81b6b-6149-4dce-bddb-d5a22da85ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:27.378595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 583/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:27.402105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd323b-02fd-4e17-8d26-8f62af92be9e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:27.504539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd323b-02fd-4e17-8d26-8f62af92be9e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:27.537290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b8a63-3280-43dd-bd51-822547f08c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:27.538079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b8a63-3280-43dd-bd51-822547f08c14 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:27.538368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b8a63-3280-43dd-bd51-822547f08c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:27.538647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b8a63-3280-43dd-bd51-822547f08c14 None admin] PATH_INFO: `/v3/domains/d0139f937a3d421a8e622acfc4059702` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:27.549422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b8a63-3280-43dd-bd51-822547f08c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d0139f937a3d421a8e622acfc4059702)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:27.550863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b8a63-3280-43dd-bd51-822547f08c14 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:27.552511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 589/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Jun 2 13:34:27 2022] GET /identity/v3/domains/d0139f937a3d421a8e622acfc4059702 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:27.558253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f81b6b-6149-4dce-bddb-d5a22da85ce4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:27.653362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f81b6b-6149-4dce-bddb-d5a22da85ce4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:27.661888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:27.688735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7798a797-bd17-45e2-85b7-98d41f1503e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:27.689390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a797-bd17-45e2-85b7-98d41f1503e6 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:27.689677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a797-bd17-45e2-85b7-98d41f1503e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:27.689958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7798a797-bd17-45e2-85b7-98d41f1503e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:27.690663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798a797-bd17-45e2-85b7-98d41f1503e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:27.692099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7798a797-bd17-45e2-85b7-98d41f1503e6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:27.761910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 584/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:34:27 2022] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:30.005360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bffa7-0d71-422b-b574-65ff2cd76acb None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:30.005898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bffa7-0d71-422b-b574-65ff2cd76acb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:30.005997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165bffa7-0d71-422b-b574-65ff2cd76acb None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:30.007305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 590/1174] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:30.012537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4146-ffce-4876-80fb-fa18746a8072 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:30.012914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4146-ffce-4876-80fb-fa18746a8072 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:30.013099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e4146-ffce-4876-80fb-fa18746a8072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:30.034192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-798e4146-ffce-4876-80fb-fa18746a8072 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:30.035384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-798e4146-ffce-4876-80fb-fa18746a8072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:30.099831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 585/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:30.125565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bffa7-0d71-422b-b574-65ff2cd76acb None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:30.142106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:30.226727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165bffa7-0d71-422b-b574-65ff2cd76acb None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:30.259167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aabda9-6a66-41e0-ab12-9c334f19a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:30.259951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aabda9-6a66-41e0-ab12-9c334f19a6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:30.260233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aabda9-6a66-41e0-ab12-9c334f19a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:30.260692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aabda9-6a66-41e0-ab12-9c334f19a6c2 None admin] PATH_INFO: `/v3/domains/d0139f937a3d421a8e622acfc4059702` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:30.261878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aabda9-6a66-41e0-ab12-9c334f19a6c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d0139f937a3d421a8e622acfc4059702)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:30.263333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aabda9-6a66-41e0-ab12-9c334f19a6c2 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:30.264958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 591/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Thu Jun 2 13:34:30 2022] GET /identity/v3/domains/d0139f937a3d421a8e622acfc4059702 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:30.270654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e4146-ffce-4876-80fb-fa18746a8072 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:30.354538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:30.366504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798e4146-ffce-4876-80fb-fa18746a8072 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:30.409146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbe658-7c3e-4a96-80c1-35ba0227995d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:30.410060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe658-7c3e-4a96-80c1-35ba0227995d None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:30.410441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe658-7c3e-4a96-80c1-35ba0227995d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:30.410720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe658-7c3e-4a96-80c1-35ba0227995d None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:30.411431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe658-7c3e-4a96-80c1-35ba0227995d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:30.412943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbe658-7c3e-4a96-80c1-35ba0227995d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:30.516190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 586/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:34:30 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:34:32.788184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d0e41-0beb-4116-8496-752059dd0f44 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:32.788815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d0e41-0beb-4116-8496-752059dd0f44 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:32.788815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d0e41-0beb-4116-8496-752059dd0f44 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:32.790072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 592/1178] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:32.795858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc998753-9cbe-47d1-aeae-6ceb621c522d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:32.796274 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc998753-9cbe-47d1-aeae-6ceb621c522d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:32.796448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc998753-9cbe-47d1-aeae-6ceb621c522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:32.814246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-cc998753-9cbe-47d1-aeae-6ceb621c522d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:32.815433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-cc998753-9cbe-47d1-aeae-6ceb621c522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:32.885260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 587/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:32.908889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d0e41-0beb-4116-8496-752059dd0f44 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:32.990680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:33.008737 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d0e41-0beb-4116-8496-752059dd0f44 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:33.041891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:33.042607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.043763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.044051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.053941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:33.061844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:33.063042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:34:33.064107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 593/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:33.069111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc998753-9cbe-47d1-aeae-6ceb621c522d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:33.147173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:33.172228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc998753-9cbe-47d1-aeae-6ceb621c522d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:33.206250 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:33.206917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.207220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.207537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.208284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:33.208621 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:33.209995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:33.222406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 588/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:34:33.228609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:33.327731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7353bf-da41-4d6d-9b49-5838e1e968a0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:33.361285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:33.362152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.362441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.362723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] PATH_INFO: `/v3/users/c372ac83aff64be69c65180a999c3886` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.373579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:33.375897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] RBAC: Authorizing `identity:get_user(user_id=c372ac83aff64be69c65180a999c3886)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:33.377370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:33.379015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 594/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:33 2022] GET /identity/v3/users/c372ac83aff64be69c65180a999c3886 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:33.384784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:33.490814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac689bac-14b4-4056-b25d-362fd0749740 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:33.523917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:33.524589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.524882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.525165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.528617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:33.590201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:33.591584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:33.686771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 589/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:33.692661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:33.793940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b83dd-61f7-4225-a0c9-1fedbba55a65 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:33.827290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93474e20-e7ed-4e48-8e23-a680b19915e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:33.828135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474e20-e7ed-4e48-8e23-a680b19915e9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.828448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474e20-e7ed-4e48-8e23-a680b19915e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.828734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93474e20-e7ed-4e48-8e23-a680b19915e9 None admin] PATH_INFO: `/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.829910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93474e20-e7ed-4e48-8e23-a680b19915e9 None admin] RBAC: Authorizing `identity:get_project(project_id=502e6e1f72b4408f94c2a7c00f8bb54b)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:33.831331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93474e20-e7ed-4e48-8e23-a680b19915e9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:33.833047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 595/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:33 2022] GET /identity/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:33.839273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:33.873590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:33.936977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9e635-c6c5-4895-95e0-709f24e2d104 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:33.969843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10be18-11e8-49bd-b60f-aa79c1efd2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:33.970486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10be18-11e8-49bd-b60f-aa79c1efd2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:33.970774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10be18-11e8-49bd-b60f-aa79c1efd2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:33.971055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10be18-11e8-49bd-b60f-aa79c1efd2d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:33.971884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10be18-11e8-49bd-b60f-aa79c1efd2d2 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=502e6e1f72b4408f94c2a7c00f8bb54b, user.id=c372ac83aff64be69c65180a999c3886) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:33.972203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10be18-11e8-49bd-b60f-aa79c1efd2d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:33.973752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10be18-11e8-49bd-b60f-aa79c1efd2d2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:33.979321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 590/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:33 2022] GET /identity/v3/role_assignments?user.id=c372ac83aff64be69c65180a999c3886&scope.project.id=502e6e1f72b4408f94c2a7c00f8bb54b&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:36.224511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceb09-d2f0-4d47-9b2c-1cb5723f4534 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.225065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceb09-d2f0-4d47-9b2c-1cb5723f4534 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.225065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ceb09-d2f0-4d47-9b2c-1cb5723f4534 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.226435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 596/1186] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:36.231928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf540-2b4a-4e11-bd58-b741de565d9c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.232360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf540-2b4a-4e11-bd58-b741de565d9c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.232537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbf540-2b4a-4e11-bd58-b741de565d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.249591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-03dbf540-2b4a-4e11-bd58-b741de565d9c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:36.250783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-03dbf540-2b4a-4e11-bd58-b741de565d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:36.317739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 591/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:36.341071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceb09-d2f0-4d47-9b2c-1cb5723f4534 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.406699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.440031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ceb09-d2f0-4d47-9b2c-1cb5723f4534 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.471833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.472628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.472915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.473192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.483811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:36.491312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:36.492425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:34:36.493608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 597/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:36.499140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf540-2b4a-4e11-bd58-b741de565d9c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.527902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.595393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbf540-2b4a-4e11-bd58-b741de565d9c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.629148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.629801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.630089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.630367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.631110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:36.631418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.632831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.640873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 592/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:36.646700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.746556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58345-39e5-4a6b-8dd8-df07df0d8c2f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.770996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.779176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.784331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.784331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.784331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] PATH_INFO: `/v3/users/c372ac83aff64be69c65180a999c3886` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.784331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] RBAC: Authorizing `identity:get_user(user_id=c372ac83aff64be69c65180a999c3886)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.784331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.784996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 598/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/users/c372ac83aff64be69c65180a999c3886 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:36.790506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:36.880051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:36.888355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97600812-bb09-4f33-908a-007c06ec2076 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:36.921612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987b0d3-b299-4e90-a76e-55ea3ad9befb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:36.922490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b0d3-b299-4e90-a76e-55ea3ad9befb None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:36.922778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b0d3-b299-4e90-a76e-55ea3ad9befb None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:36.923057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987b0d3-b299-4e90-a76e-55ea3ad9befb None admin] PATH_INFO: `/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:36.924232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987b0d3-b299-4e90-a76e-55ea3ad9befb None admin] RBAC: Authorizing `identity:get_project(project_id=502e6e1f72b4408f94c2a7c00f8bb54b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:36.925704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987b0d3-b299-4e90-a76e-55ea3ad9befb None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:36.927377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 593/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:36 2022] GET /identity/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:36.933467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:37.031319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1209f46-45b6-43c8-95fd-8b594f931f34 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:37.064481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b8d99-bc48-4af3-881a-335727f8181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:37.065360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8d99-bc48-4af3-881a-335727f8181b None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:37.065647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8d99-bc48-4af3-881a-335727f8181b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:37.065927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b8d99-bc48-4af3-881a-335727f8181b None admin] PATH_INFO: `/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b/users/c372ac83aff64be69c65180a999c3886/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:37.067903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b8d99-bc48-4af3-881a-335727f8181b None admin] RBAC: Authorizing `identity:create_grant(project_id=502e6e1f72b4408f94c2a7c00f8bb54b, user_id=c372ac83aff64be69c65180a999c3886, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:37.069564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b8d99-bc48-4af3-881a-335727f8181b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:37.160662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 599/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:34:36 2022] PUT /identity/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b/users/c372ac83aff64be69c65180a999c3886/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:34:39.393548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191f8e-ecdf-4267-b84f-80e30b98ca1e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.394132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191f8e-ecdf-4267-b84f-80e30b98ca1e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.394132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84191f8e-ecdf-4267-b84f-80e30b98ca1e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.395459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 594/1193] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:34:39.400783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213bf1-f372-47f4-a2c6-f24c45524ba6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.401207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213bf1-f372-47f4-a2c6-f24c45524ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.401342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b213bf1-f372-47f4-a2c6-f24c45524ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.419334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-4b213bf1-f372-47f4-a2c6-f24c45524ba6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:34:39.420580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4b213bf1-f372-47f4-a2c6-f24c45524ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:34:39.470200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:39.487310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 600/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:34:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:34:39.512016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191f8e-ecdf-4267-b84f-80e30b98ca1e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:39.614227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84191f8e-ecdf-4267-b84f-80e30b98ca1e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:39.646589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:39.647301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.647584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.647862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.658651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:34:39.666036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:34:39.667218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:34:39.668364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 595/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:34:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:34:39.673207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b213bf1-f372-47f4-a2c6-f24c45524ba6 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:39.770236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b213bf1-f372-47f4-a2c6-f24c45524ba6 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:39.802440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:39.803096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.803386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.803669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.804436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:39.804757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:39.806123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:39.814591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 601/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:34:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:39.820278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:39.842224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:39.917840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d49356-a358-4a57-bf18-43e24aaa3800 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:39.951538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:39.952381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:39.952701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:39.952981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] PATH_INFO: `/v3/users/c372ac83aff64be69c65180a999c3886` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:39.954156 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] RBAC: Authorizing `identity:get_user(user_id=c372ac83aff64be69c65180a999c3886)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:39.955598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:39.957229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 596/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Thu Jun 2 13:34:39 2022] GET /identity/v3/users/c372ac83aff64be69c65180a999c3886 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:39.962800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.012521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:40.062384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4985a-1f4a-4926-94be-8f4bd80ffc38 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.094617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.095253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.095541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.095822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.167153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.170541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.216965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:40.268250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 602/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:34:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:34:40.274151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.358692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:40.369917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d53ed-58d9-49b1-a8d2-f8f3de617b03 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.402906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721bded2-63e8-4541-ad2b-510f5b2e2d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.403744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bded2-63e8-4541-ad2b-510f5b2e2d13 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.404026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bded2-63e8-4541-ad2b-510f5b2e2d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.404301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721bded2-63e8-4541-ad2b-510f5b2e2d13 None admin] PATH_INFO: `/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.405487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bded2-63e8-4541-ad2b-510f5b2e2d13 None admin] RBAC: Authorizing `identity:get_project(project_id=502e6e1f72b4408f94c2a7c00f8bb54b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.406922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721bded2-63e8-4541-ad2b-510f5b2e2d13 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.408602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 597/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Thu Jun 2 13:34:40 2022] GET /identity/v3/projects/502e6e1f72b4408f94c2a7c00f8bb54b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:40.414734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:34:40.512238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbde3c-0460-44f1-80d6-aad46a8642aa None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:34:40.546229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a11b9-ef2e-4aca-b149-9ce5f838fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:34:40.546873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a11b9-ef2e-4aca-b149-9ce5f838fcea None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:34:40.547157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a11b9-ef2e-4aca-b149-9ce5f838fcea None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:34:40.547434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a11b9-ef2e-4aca-b149-9ce5f838fcea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:34:40.548256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a11b9-ef2e-4aca-b149-9ce5f838fcea None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=502e6e1f72b4408f94c2a7c00f8bb54b, user.id=c372ac83aff64be69c65180a999c3886) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:34:40.548599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a11b9-ef2e-4aca-b149-9ce5f838fcea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:34:40.550031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a11b9-ef2e-4aca-b149-9ce5f838fcea None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:34:40.555638 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 603/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:34:40 2022] GET /identity/v3/role_assignments?user.id=c372ac83aff64be69c65180a999c3886&scope.project.id=502e6e1f72b4408f94c2a7c00f8bb54b&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:34:50.398805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=22 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:34:50.553083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.524723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd9f1-ae26-483c-b867-a0662e53cf4c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.525281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd9f1-ae26-483c-b867-a0662e53cf4c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.525281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcd9f1-ae26-483c-b867-a0662e53cf4c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.526777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 598/1201] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:02.532073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74b95-e1d6-4979-a69e-53cef739788a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.532557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74b95-e1d6-4979-a69e-53cef739788a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.532659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74b95-e1d6-4979-a69e-53cef739788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.549768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-16b74b95-e1d6-4979-a69e-53cef739788a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:02.551052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-16b74b95-e1d6-4979-a69e-53cef739788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:02.616080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 604/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:02.642100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd9f1-ae26-483c-b867-a0662e53cf4c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.746010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bcd9f1-ae26-483c-b867-a0662e53cf4c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.780677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.781384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.781663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.781932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.791881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.793358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:02.810279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:02.811419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:02.812676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:02.812676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:02.812676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:02.812676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:02.812676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 599/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:02.817744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74b95-e1d6-4979-a69e-53cef739788a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:02.915399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74b95-e1d6-4979-a69e-53cef739788a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:02.943528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:02.950171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50018b-a39c-413f-be37-0344cd5563ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:02.950837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50018b-a39c-413f-be37-0344cd5563ce None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:02.951129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50018b-a39c-413f-be37-0344cd5563ce None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:02.951413 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50018b-a39c-413f-be37-0344cd5563ce None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:02.952138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50018b-a39c-413f-be37-0344cd5563ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:02.952474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50018b-a39c-413f-be37-0344cd5563ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:02.953849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50018b-a39c-413f-be37-0344cd5563ce None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:02.965660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 605/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:02.971380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:03.023776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:03.068091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897c176-f9e4-4e29-babd-a3b2739fe939 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:03.100966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46486a75-f84e-4f76-b498-ea46b5d9447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:03.101619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486a75-f84e-4f76-b498-ea46b5d9447d None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:03.101979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486a75-f84e-4f76-b498-ea46b5d9447d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:03.102450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486a75-f84e-4f76-b498-ea46b5d9447d None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:03.103496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46486a75-f84e-4f76-b498-ea46b5d9447d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:03.104957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46486a75-f84e-4f76-b498-ea46b5d9447d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:03.198143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 600/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Thu Jun 2 13:36:02 2022] POST /identity/v3/users => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:36:05.491444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246f91-ae36-4ec8-97f1-40104910afb5 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.491986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246f91-ae36-4ec8-97f1-40104910afb5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.492106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1246f91-ae36-4ec8-97f1-40104910afb5 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.494027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 606/1206] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:05.500171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d2dda-a1a9-42d2-8ef9-87bbd7342b1c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.500597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d2dda-a1a9-42d2-8ef9-87bbd7342b1c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.500780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d2dda-a1a9-42d2-8ef9-87bbd7342b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.518108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-958d2dda-a1a9-42d2-8ef9-87bbd7342b1c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:05.520258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-958d2dda-a1a9-42d2-8ef9-87bbd7342b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:05.584616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 601/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:05.609472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1246f91-ae36-4ec8-97f1-40104910afb5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.712039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1246f91-ae36-4ec8-97f1-40104910afb5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.758677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.759400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.759711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.759978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.770458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:05.778409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:05.780314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:05.781403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 607/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:05.785516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d2dda-a1a9-42d2-8ef9-87bbd7342b1c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.825158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:05.882651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d2dda-a1a9-42d2-8ef9-87bbd7342b1c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:05.918427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:05.919098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:05.919386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:05.919667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:05.920474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:05.920790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:05.922165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:05.930897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 602/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:05.936581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:05.987188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.037096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ba8d9-0c0c-4800-a8ef-db4f92081894 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.076338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.077167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.077455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.077724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.090269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.091741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:06.110978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:06.112733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:06.113923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:06.113923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:06.113923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:06.113923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:06.113923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 608/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:06.118402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.216834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.219705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cafb2-b2e5-449e-b725-f3304eb7da0e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.252755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.253452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.253739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.254018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.254735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.255045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.256457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.267996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 603/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.274643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.372746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654289-4a02-4532-b3c8-ad77a67d5a11 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.374196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.408385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.409205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.409492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.409770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.416774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.418203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:06.432524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:06.433696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:06.434954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 609/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:06.439481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.539791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e015b72-0cf5-448c-979d-c75fec9a7a0f None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.573207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.573889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.574171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.574444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.575258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:06.575563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.577070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.594344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 604/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:06.600427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.701633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37264cbe-d674-4dbe-91b2-55a9f6c99b6b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:06.735291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:06.735931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:06.736234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:06.736544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:06.768265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:06.804015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:06.806133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:06.903350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 610/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 02 13:36:06.906779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:06.925384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.003528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42844b53-9337-4eea-9700-f3ce5157615d None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.036921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.037697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.037979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.038253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.048017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.049483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:07.067029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:07.072845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:07.073947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:07.073947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:07.073947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:07.073947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:07.073947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 605/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:07.075227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.140325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.178184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52787304-8aac-4ef6-982c-670374536a96 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.213240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.213982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.214275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.214559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.215278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.215589 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.217005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.228951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 611/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:07.234598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.305669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.335316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ba51f-c983-4ea6-a518-9a8d44cdd404 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.368258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.369069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.369358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.369638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.377829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.380481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:07.395184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:07.396327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:07.397576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 606/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:07.403155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.502490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47460ff3-0d2e-4d77-b8aa-190bbea206ec None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.524763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.535922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379f7c5-9487-453b-b1ed-dc95a40fa3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.536609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f7c5-9487-453b-b1ed-dc95a40fa3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.536897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f7c5-9487-453b-b1ed-dc95a40fa3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.537170 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379f7c5-9487-453b-b1ed-dc95a40fa3a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.537960 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379f7c5-9487-453b-b1ed-dc95a40fa3a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.538265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379f7c5-9487-453b-b1ed-dc95a40fa3a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.539748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379f7c5-9487-453b-b1ed-dc95a40fa3a6 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.551176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 612/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:07.560451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:07.657510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451a392-f083-4aa6-8134-bb1e933741ae None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:07.688187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:07.697364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edef817-7ec8-4d32-bd3a-4949235d4040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:07.698318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edef817-7ec8-4d32-bd3a-4949235d4040 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:07.698743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edef817-7ec8-4d32-bd3a-4949235d4040 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:07.699158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edef817-7ec8-4d32-bd3a-4949235d4040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:07.700582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edef817-7ec8-4d32-bd3a-4949235d4040 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=d4c0df21b3954b5d9dffd54643125817) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:07.701140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edef817-7ec8-4d32-bd3a-4949235d4040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:07.703787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edef817-7ec8-4d32-bd3a-4949235d4040 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:07.710095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 607/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:07 2022] GET /identity/v3/role_assignments?user.id=d4c0df21b3954b5d9dffd54643125817&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:09.956108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4735c-bcde-4fdc-a151-ef439d64674b None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.956704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4735c-bcde-4fdc-a151-ef439d64674b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.956704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f4735c-bcde-4fdc-a151-ef439d64674b None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.958054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 613/1220] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:09.963501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18373-ec0a-4c61-90e9-e00288635f33 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:09.963918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18373-ec0a-4c61-90e9-e00288635f33 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:09.964071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18373-ec0a-4c61-90e9-e00288635f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:09.981373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8fc18373-ec0a-4c61-90e9-e00288635f33 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:09.982568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8fc18373-ec0a-4c61-90e9-e00288635f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:10.048259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 608/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:10.071845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4735c-bcde-4fdc-a151-ef439d64674b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.178018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f4735c-bcde-4fdc-a151-ef439d64674b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.210934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.211740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.212018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.212299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.222429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:10.231506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:10.232762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:10.233953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 614/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:10.238665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18373-ec0a-4c61-90e9-e00288635f33 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.339090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18373-ec0a-4c61-90e9-e00288635f33 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.364559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.375746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.376427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.376730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.377006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.377746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:10.378051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.379471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.387501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 609/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:10.393459 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.441426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.497727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65843b0-8548-4c57-853c-c03c020c49d0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.531372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.532173 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.532493 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.532777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.543807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.545288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:10.561841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:10.562775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:10.563724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:10.563724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:10.563724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:10.563724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:10.563724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 615/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:10.568817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.670967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df9685-6ed3-4c15-96a3-c5a3310e7c52 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.705590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.706252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.706537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.706814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.707534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:10.707844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.709269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.721686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 610/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:10.727719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.823868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.830328 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c9f6a-2e45-47d8-be32-3ee5de1db18f None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:10.863195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:10.863992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:10.864277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:10.864591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:10.872791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:10.874218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:10.888244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:10.894670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:10.895707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 616/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 02 13:36:10.896356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:10.942119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:10.993813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032d4a3-7e2d-40a2-b5a2-dfaf814c8e40 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:11.026973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:11.027634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.027924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.028205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.029074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:11.030734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:11.030883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:11.048202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 611/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 2 13:36:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:11.053687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:11.153507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5064b41-456a-4715-b355-09acd7fd7d70 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:11.186701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:11.187480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.187769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.188047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.199684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:11.201177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:11.218558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:11.219750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:11.220763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:11.220763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:11.220763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:11.220763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:11.220763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 617/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:11.225640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:11.323902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a7ead-dd48-4dbd-975e-69e938282cb4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:11.326186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:11.360858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c78898-b514-49a2-af8c-431767768500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:11.361610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78898-b514-49a2-af8c-431767768500 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.361938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78898-b514-49a2-af8c-431767768500 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.362331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c78898-b514-49a2-af8c-431767768500 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.363138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c78898-b514-49a2-af8c-431767768500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:11.363490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c78898-b514-49a2-af8c-431767768500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:11.365019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c78898-b514-49a2-af8c-431767768500 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:11.378699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 612/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:11.384424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:11.393832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:11.483366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbadef-04ec-4d3f-8e0c-b7963f057f34 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:11.517974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:11.518757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.519074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.519397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.526106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:11.527586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:11.541698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:11.542796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:11.543938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 618/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:11.548852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c78898-b514-49a2-af8c-431767768500 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:11.649145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c78898-b514-49a2-af8c-431767768500 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:11.683435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222fff0-0b0a-4423-a2de-18e1f13f9a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:11.684098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222fff0-0b0a-4423-a2de-18e1f13f9a0e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.684383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222fff0-0b0a-4423-a2de-18e1f13f9a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.684702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222fff0-0b0a-4423-a2de-18e1f13f9a0e None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.685486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222fff0-0b0a-4423-a2de-18e1f13f9a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:11.685798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222fff0-0b0a-4423-a2de-18e1f13f9a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:11.687257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222fff0-0b0a-4423-a2de-18e1f13f9a0e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:11.700259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 613/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:11.706217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:11.771304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:11.804422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeeaa34-3d5e-4212-98e7-dfaacfdfdcb7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:11.838137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8f2eb-9cd1-47b4-8db9-8a8e5e8adbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:11.839010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f2eb-9cd1-47b4-8db9-8a8e5e8adbea None admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:11.839293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f2eb-9cd1-47b4-8db9-8a8e5e8adbea None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:11.839569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f2eb-9cd1-47b4-8db9-8a8e5e8adbea None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/d4c0df21b3954b5d9dffd54643125817/roles/02b52b44bf4341fc9f58c196cadecfe9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:11.853795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f2eb-9cd1-47b4-8db9-8a8e5e8adbea None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=d4c0df21b3954b5d9dffd54643125817, role_id=02b52b44bf4341fc9f58c196cadecfe9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:11.855225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8f2eb-9cd1-47b4-8db9-8a8e5e8adbea None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:11.992040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 619/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:11 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/d4c0df21b3954b5d9dffd54643125817/roles/02b52b44bf4341fc9f58c196cadecfe9 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:14.256872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045786a-0632-4876-9c8f-fd44b4d6cf7a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.257447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045786a-0632-4876-9c8f-fd44b4d6cf7a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.257447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045786a-0632-4876-9c8f-fd44b4d6cf7a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.258836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 614/1233] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:14.264308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dde38-147b-487c-9cae-7b87a39d838c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.264802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dde38-147b-487c-9cae-7b87a39d838c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.265290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dde38-147b-487c-9cae-7b87a39d838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.282220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a12dde38-147b-487c-9cae-7b87a39d838c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:14.283435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a12dde38-147b-487c-9cae-7b87a39d838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:14.349467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 620/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 02 13:36:14.373800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045786a-0632-4876-9c8f-fd44b4d6cf7a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.399654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.474342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045786a-0632-4876-9c8f-fd44b4d6cf7a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.510935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.511677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.511966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.512247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.522549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:14.530865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:14.531989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:14.533145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 615/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:14.538295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dde38-147b-487c-9cae-7b87a39d838c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.584344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.636023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dde38-147b-487c-9cae-7b87a39d838c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.668947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.669618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.669925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.670191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.670937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] RBAC: Adding query filter params (name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:14.671247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.672643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.681543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 621/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:14.687347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.772224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:14.787990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a73a809-d023-4121-94c7-15983a31ca85 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.825462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:14.826246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:14.826531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:14.826810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:14.838062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:14.839520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:14.857579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:14.858712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:14.859855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:14.859855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:14.859855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:14.859855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:14.859855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 616/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:14.864861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:14.965204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61144db-6b87-4547-a8ef-37ca77bf123b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:14.975185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.000613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.001479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.001769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.002130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.002852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:15.003166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.004591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.016193 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 622/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:15.021908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.126484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352446d-15fa-408f-80c9-b4a5b389fd20 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.159880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.160751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.161038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.161317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.163978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.169087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.170660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:15.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:15.186286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:15.187471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 617/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:15.192477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.289663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb03a2-d6fd-4dbd-b6c7-ce711eb7ca66 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.323083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.323742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.324023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.324325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.325182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:15.325488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.326960 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.343486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 623/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:15.349477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.447720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee04f7-d8fa-41f8-b535-e9504d5815e4 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.480791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.481434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.481725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.482009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.542784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.549233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.550704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.647764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 618/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:15.653628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.681392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.753710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6399f3da-4bb6-44d6-ade3-9d1fdcf46e65 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.787529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.788312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.788623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.788900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.799343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.800810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:15.818241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:15.822552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:15.823744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:15.823744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:15.823744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:15.823744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:15.823744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 624/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:15.825587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:15.918703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:15.924253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358b7c9-2ae5-41e3-beec-f76b750ec747 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:15.957529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:15.958179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:15.958464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:15.958741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:15.959455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:15.959760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:15.961209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:15.972014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 619/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:15.978177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.056959 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:16.077393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a7e1-9c35-4d5c-b3e0-c43ba171dfd9 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.114243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.114870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.115158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.115435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.126254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.128633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:16.153808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:16.154952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:16.156067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 625/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:16.161641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.280251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead5849-852a-4974-b6ad-626407cd5743 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.316427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5479d2a-549e-41f1-b0fa-df76fdb28cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.317018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479d2a-549e-41f1-b0fa-df76fdb28cef None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.317305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479d2a-549e-41f1-b0fa-df76fdb28cef None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.317583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479d2a-549e-41f1-b0fa-df76fdb28cef None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.318366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479d2a-549e-41f1-b0fa-df76fdb28cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:16.318677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479d2a-549e-41f1-b0fa-df76fdb28cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.320718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479d2a-549e-41f1-b0fa-df76fdb28cef None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.332994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 620/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:16.343902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:16.440240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a275ffc-e704-4a5d-866f-d7c93a428c00 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:16.473706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ae853-9ac9-4fd2-939d-1ead14302f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:16.474725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae853-9ac9-4fd2-939d-1ead14302f90 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:16.475011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae853-9ac9-4fd2-939d-1ead14302f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:16.475287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ae853-9ac9-4fd2-939d-1ead14302f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:16.476126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ae853-9ac9-4fd2-939d-1ead14302f90 None admin] RBAC: Adding query filter params (role.id=02b52b44bf4341fc9f58c196cadecfe9, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=d4c0df21b3954b5d9dffd54643125817) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:16.477076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ae853-9ac9-4fd2-939d-1ead14302f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:16.478744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ae853-9ac9-4fd2-939d-1ead14302f90 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:16.486072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 626/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:16 2022] GET /identity/v3/role_assignments?user.id=d4c0df21b3954b5d9dffd54643125817&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=02b52b44bf4341fc9f58c196cadecfe9 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:18.805408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaaf70-7326-4f16-b6c2-af2405dfdb53 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.805971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaaf70-7326-4f16-b6c2-af2405dfdb53 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.805971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbaaf70-7326-4f16-b6c2-af2405dfdb53 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.807259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 621/1247] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:18.812504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006bcb2-6aea-498a-8d52-01704e756228 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:18.812901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006bcb2-6aea-498a-8d52-01704e756228 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:18.815788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006bcb2-6aea-498a-8d52-01704e756228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:18.818137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:18.830709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6006bcb2-6aea-498a-8d52-01704e756228 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:18.831907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6006bcb2-6aea-498a-8d52-01704e756228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:18.900550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 627/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:18.924170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaaf70-7326-4f16-b6c2-af2405dfdb53 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:18.942764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.023101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbaaf70-7326-4f16-b6c2-af2405dfdb53 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.057348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.058167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.058455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.058735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.068711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:19.076898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:19.081702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:19.082696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 622/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:19.084553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006bcb2-6aea-498a-8d52-01704e756228 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.183392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006bcb2-6aea-498a-8d52-01704e756228 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.213147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.218021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.218681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.218965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.219243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.220051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:19.220302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.221697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.230198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 628/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:19.235952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.316289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.339121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c88c97-6297-4ee8-97f9-5f9b0ef44e40 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.371652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.372467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.372761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.373043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.383904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.385407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:19.402810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:19.403886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:19.405051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:19.405051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:19.405051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:19.405051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:19.405051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 623/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:19.409883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.509692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef27a-d0b7-49d8-b55b-20ea925104a7 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.542506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.543163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.543453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.543736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.544479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:19.544792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.546157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.558321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 629/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:19.563944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.664185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65be56-35d2-44bc-be27-d774b7082aa7 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.689270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.697509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.698291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.698570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.698863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.706221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.707655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:19.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:19.722903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:19.724180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 624/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:19.729124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.785029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:19.829737 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8bff2-1c5b-4162-a441-6fb43f9ec4ce None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:19.863232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:19.863964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:19.864257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:19.864578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:19.865411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:19.865725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:19.867779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:19.884817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 630/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:19.890609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:19.992734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2c075-eb77-4bcc-ac77-d1ad0b41b61b None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.025840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.026485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.026773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.027054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.081143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.093010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.094468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.191294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 625/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:20.197652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.302580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef59680-0ea1-4e20-9031-d161ad45fe92 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.315577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.336529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.337311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.337597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.337873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.347645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.349371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:20.367637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:20.368866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:20.373632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:20.373632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:20.373632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:20.373632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:20.373632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 631/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:20.374597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.459996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.472500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53fd82-41df-4f0d-9dc4-3d0f9207f792 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.528023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.528727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.529018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.529299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.530019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:20.530331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.531706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.543884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 626/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:20.549619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.651204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243838-5cce-4fb7-b00b-b4b1a68ede64 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.684787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.685593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.685878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.686153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.692602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.694192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:20.707679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:20.708803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:20.710133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 632/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:20.714788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.814055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d61fa9b-e17f-4753-b829-acdf2e6b59dd None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:20.853255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1aaeac-3739-453c-8352-eb258667b6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:20.854282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aaeac-3739-453c-8352-eb258667b6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:20.854759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aaeac-3739-453c-8352-eb258667b6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:20.855094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1aaeac-3739-453c-8352-eb258667b6e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:20.856516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1aaeac-3739-453c-8352-eb258667b6e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:20.856516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1aaeac-3739-453c-8352-eb258667b6e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:20.857967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1aaeac-3739-453c-8352-eb258667b6e2 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:20.878510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 627/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:20.884853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:20.910753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:20.984805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e517a5-ae4b-41d1-9d42-01ef3f679e68 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:21.016512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90d0e46-f11c-4bb9-8eb9-b4efca20710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:21.017158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0e46-f11c-4bb9-8eb9-b4efca20710b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:21.017485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0e46-f11c-4bb9-8eb9-b4efca20710b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:21.017764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90d0e46-f11c-4bb9-8eb9-b4efca20710b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:21.018591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d0e46-f11c-4bb9-8eb9-b4efca20710b None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=d4c0df21b3954b5d9dffd54643125817) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:21.024113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d0e46-f11c-4bb9-8eb9-b4efca20710b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:21.024113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90d0e46-f11c-4bb9-8eb9-b4efca20710b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:21.026192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 633/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:20 2022] GET /identity/v3/role_assignments?user.id=d4c0df21b3954b5d9dffd54643125817&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=add60904ef824ad3b92149e0f251f55c => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:23.308166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a490ed0-58d6-4f17-b70b-6ad8143d0fde None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.308736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a490ed0-58d6-4f17-b70b-6ad8143d0fde None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.308736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a490ed0-58d6-4f17-b70b-6ad8143d0fde None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.310116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 628/1261] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:23.315290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305567f-6f6e-473e-bbf1-80838adee627 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.316428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305567f-6f6e-473e-bbf1-80838adee627 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.316428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305567f-6f6e-473e-bbf1-80838adee627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.332492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5305567f-6f6e-473e-bbf1-80838adee627 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:23.333730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5305567f-6f6e-473e-bbf1-80838adee627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:23.403431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 634/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:23.426637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a490ed0-58d6-4f17-b70b-6ad8143d0fde None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.438416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.533636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a490ed0-58d6-4f17-b70b-6ad8143d0fde None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.569790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.571281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.571570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.571846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.581872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:23.589571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:23.590709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:23.591835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 629/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:23.596759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305567f-6f6e-473e-bbf1-80838adee627 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.615664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.696563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305567f-6f6e-473e-bbf1-80838adee627 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.730097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.730764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.731054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.731337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.732079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:23.732391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.733860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.742523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 635/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:23.748385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.814166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:23.846153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c3e60-b1d3-4d26-838a-42d7df2102b2 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:23.879700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:23.880530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:23.880819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:23.881095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:23.891287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:23.892806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:23.909553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:23.910644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:23.911565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:23.911565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:23.911565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:23.911565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:23.911565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 630/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:23.917364 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:23.999639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.018300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3ee2a-c786-4715-892a-2f4c6f9ed7ff None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.052061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.052744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.053032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.053312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.054026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.054958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.056330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.067741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 636/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.073528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.175458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9f1d3-343c-4cfe-a775-8615b6e7eca5 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.194681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.208365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.209188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.209477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.209756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.217926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.219369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:24.234777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:24.240856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:24.241871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 631/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:24.242484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.339533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130359-205f-4eb0-8f8f-ffc05c9ba17e None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.373900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.374566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.374857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.375142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.375977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.376291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.377764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.386834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.523746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 637/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.529385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.628225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb249af-7b63-4fe8-b9e6-7f4a39f4cf95 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.662263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.663059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.663342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.663660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.674002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.675549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:24.692223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:24.693198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:24.694130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:24.694130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:24.694130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:24.694130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:24.694130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 632/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:24.700066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.797449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1a567-6053-4703-a15a-fec764c5fbcd None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.832636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.833312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.833601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.833878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.834594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:24.834902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.836712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:24.847881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 638/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:24.854460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:24.887417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:24.956217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4147e0-e7e2-4763-a4c0-a9eac848c844 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:24.988759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:24.989531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:24.989812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:24.990086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:24.997379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:24.998885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:25.013521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:25.014569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:25.015854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 633/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:25.020684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:25.077787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:25.118877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42980bee-fbda-4d1a-a6bb-6ba02c38b94c None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:25.151142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627f390-d229-4acb-9e34-1e699b83b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:25.151817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627f390-d229-4acb-9e34-1e699b83b148 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.152107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627f390-d229-4acb-9e34-1e699b83b148 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.152391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627f390-d229-4acb-9e34-1e699b83b148 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.153206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627f390-d229-4acb-9e34-1e699b83b148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:25.153518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627f390-d229-4acb-9e34-1e699b83b148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:25.154942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627f390-d229-4acb-9e34-1e699b83b148 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.166740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 639/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:36:25.173013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:25.265597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:25.274107 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfc593-3f40-495f-8d7c-43d0a77fa7a6 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:25.308817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e6889-67a6-4b40-a3c2-b3ad8aa9af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:25.309703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6889-67a6-4b40-a3c2-b3ad8aa9af17 None admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:25.309987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6889-67a6-4b40-a3c2-b3ad8aa9af17 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:25.310263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e6889-67a6-4b40-a3c2-b3ad8aa9af17 None admin] PATH_INFO: `/v3/projects/51230e971b9b4f1fa066c75c70521656/users/d4c0df21b3954b5d9dffd54643125817/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:25.312204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e6889-67a6-4b40-a3c2-b3ad8aa9af17 None admin] RBAC: Authorizing `identity:create_grant(project_id=51230e971b9b4f1fa066c75c70521656, user_id=d4c0df21b3954b5d9dffd54643125817, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:25.313677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e6889-67a6-4b40-a3c2-b3ad8aa9af17 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:25.396917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 634/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Thu Jun 2 13:36:25 2022] PUT /identity/v3/projects/51230e971b9b4f1fa066c75c70521656/users/d4c0df21b3954b5d9dffd54643125817/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:36:27.633076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30da5-6209-4a93-8e89-453c87051497 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.633621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30da5-6209-4a93-8e89-453c87051497 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.633621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d30da5-6209-4a93-8e89-453c87051497 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.635039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 640/1274] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:27.640476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2970676-a699-46de-9991-9a9a72c624d6 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.640891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2970676-a699-46de-9991-9a9a72c624d6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.641049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2970676-a699-46de-9991-9a9a72c624d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.657209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-f2970676-a699-46de-9991-9a9a72c624d6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:27.658417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f2970676-a699-46de-9991-9a9a72c624d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:27.725656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 635/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:27.750671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d30da5-6209-4a93-8e89-453c87051497 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:27.868532 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d30da5-6209-4a93-8e89-453c87051497 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:27.892848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:27.909565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:27.910356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:27.910642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:27.910922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:27.921316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 02 13:36:27.929601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:27.931012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:27.931991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 641/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:27.938015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2970676-a699-46de-9991-9a9a72c624d6 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.018793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.037038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2970676-a699-46de-9991-9a9a72c624d6 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.070473 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.071133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.071423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.071725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.072476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:28.072791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.074179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.082088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 636/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Thu Jun 2 13:36:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:28.088088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.188751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5ef19-493a-4f2a-908e-630e528a89d0 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.224220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.225038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.225320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.225593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.236492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.237987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:28.255778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:28.256893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:28.258280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:28.258280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:28.258280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:28.258280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:28.258280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 642/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:28.262778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.362483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e69ef0-08cb-4d76-8872-18d2e1167b5e None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.395261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.395916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.396207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.396519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.397241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:28.397550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.399190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.410852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 637/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:28.417225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.449047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.516183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd41ae6-6e58-438f-b5fd-4dca3aff519d None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.549391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.550181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.550463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.550739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.558013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.559452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 02 13:36:28.573270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:28.574419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:28.575590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 643/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:28.580160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.583940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.680803 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be8c02f-2e46-4a59-8d80-cc50a5f5d2af None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.714515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.715175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.715461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.715740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.716654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:28.716917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.718357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:28.736103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 638/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:28.742633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:28.831685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:28.841148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc38c8-49d5-4c34-aef0-9ff9ca082770 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:28.875406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:28.876045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:28.876327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:28.876633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:28.942264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:28.943666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.030367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.040282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 644/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Thu Jun 2 13:36:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 02 13:36:29.046073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.107599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.146063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e7072-2d10-498d-9ec8-63ff3aa0a993 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.181636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.182417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.182704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.182981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.192860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.194258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 02 13:36:29.213247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:29.214297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:29.215394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 02 13:36:29.215394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 02 13:36:29.215394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 02 13:36:29.215394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:29.215394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 639/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:29.220277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.317276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02459824-7d71-431a-a549-37b5f92eba76 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.351449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.352071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.352360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.352671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.353391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:29.353702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.355076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.366082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 645/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:29.372779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.469546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46062b5a-91dc-4bf3-b2bc-bc34b6943f40 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.483778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.504019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.504852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.505125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.505400 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.512542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.514118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 02 13:36:29.527980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:29.531575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: ERROR keystone.server.flask.application Jun 02 13:36:29.532838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 640/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:29.535232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.585028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:29.634165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda4cd2-acf8-4dca-a320-4cd1c4fdcec3 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.666887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961284c-143a-4af9-9b29-5c59626e60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.667561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961284c-143a-4af9-9b29-5c59626e60f1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.667847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961284c-143a-4af9-9b29-5c59626e60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.668126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961284c-143a-4af9-9b29-5c59626e60f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.668927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961284c-143a-4af9-9b29-5c59626e60f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:29.669232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961284c-143a-4af9-9b29-5c59626e60f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.670658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961284c-143a-4af9-9b29-5c59626e60f1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.683318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 646/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:29.689590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:29.789980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59efd18f-2464-4717-8d5f-ee7034b3a5c9 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:29.823484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8feb08-2b45-4fe1-91e3-5c083b177926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:29.824133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8feb08-2b45-4fe1-91e3-5c083b177926 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:29.824444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8feb08-2b45-4fe1-91e3-5c083b177926 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:29.824733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8feb08-2b45-4fe1-91e3-5c083b177926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:29.825565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8feb08-2b45-4fe1-91e3-5c083b177926 None admin] RBAC: Adding query filter params (role.id=add60904ef824ad3b92149e0f251f55c, scope.project.id=51230e971b9b4f1fa066c75c70521656, user.id=d4c0df21b3954b5d9dffd54643125817) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:29.825878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8feb08-2b45-4fe1-91e3-5c083b177926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:29.827321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8feb08-2b45-4fe1-91e3-5c083b177926 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:29.833112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 641/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Thu Jun 2 13:36:29 2022] GET /identity/v3/role_assignments?user.id=d4c0df21b3954b5d9dffd54643125817&scope.project.id=51230e971b9b4f1fa066c75c70521656&role.id=add60904ef824ad3b92149e0f251f55c => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:32.130498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47e0b9-bf07-440c-9f0d-71e593e6511c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.131070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47e0b9-bf07-440c-9f0d-71e593e6511c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.131070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b47e0b9-bf07-440c-9f0d-71e593e6511c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.132494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 647/1288] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:32.137882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5200-1ef1-415f-9f2b-04a3324620c6 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.138262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5200-1ef1-415f-9f2b-04a3324620c6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.138455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b5200-1ef1-415f-9f2b-04a3324620c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.155622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-862b5200-1ef1-415f-9f2b-04a3324620c6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:32.156875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-862b5200-1ef1-415f-9f2b-04a3324620c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:32.188468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:32.228253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 642/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:32.251029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47e0b9-bf07-440c-9f0d-71e593e6511c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:32.351681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b47e0b9-bf07-440c-9f0d-71e593e6511c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:32.362252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:32.384543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:32.385263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.385559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.385819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.386465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:32.387815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:32.399767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:32.405951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:32.407043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 648/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:32.408079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5200-1ef1-415f-9f2b-04a3324620c6 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:32.505190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b5200-1ef1-415f-9f2b-04a3324620c6 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:32.539291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea465e9-97d2-41e3-b71e-905378b8cc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:32.539946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea465e9-97d2-41e3-b71e-905378b8cc19 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.540235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea465e9-97d2-41e3-b71e-905378b8cc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.540548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea465e9-97d2-41e3-b71e-905378b8cc19 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.541259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea465e9-97d2-41e3-b71e-905378b8cc19 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:32.541570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea465e9-97d2-41e3-b71e-905378b8cc19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:32.542962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea465e9-97d2-41e3-b71e-905378b8cc19 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:32.547695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 643/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 2 13:36:32 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:32.553569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:32.654067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeaecb6-2652-4f4a-91c8-840b513aa428 None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:32.686254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040f455-4da8-4c2c-85e8-bfbaf96692eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:32.686899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f455-4da8-4c2c-85e8-bfbaf96692eb None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:32.687187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f455-4da8-4c2c-85e8-bfbaf96692eb None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:32.687463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f455-4da8-4c2c-85e8-bfbaf96692eb None admin] PATH_INFO: `/v3/services` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:32.688158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f455-4da8-4c2c-85e8-bfbaf96692eb None admin] RBAC: Adding query filter params (type=placement) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:32.688490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f455-4da8-4c2c-85e8-bfbaf96692eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:32.689849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040f455-4da8-4c2c-85e8-bfbaf96692eb None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:32.694146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 649/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 2 13:36:32 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:34.997066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b337c1-34ca-4c9a-9214-02443e7d2f1b None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:34.997609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b337c1-34ca-4c9a-9214-02443e7d2f1b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:34.997728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b337c1-34ca-4c9a-9214-02443e7d2f1b None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:34.999009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 644/1293] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:35.004290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa781e-7a52-45bb-9561-6502f602395d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.004770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa781e-7a52-45bb-9561-6502f602395d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.004866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa781e-7a52-45bb-9561-6502f602395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.024567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-22aa781e-7a52-45bb-9561-6502f602395d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:35.025764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-22aa781e-7a52-45bb-9561-6502f602395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:35.055099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.091680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 650/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:35.115092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b337c1-34ca-4c9a-9214-02443e7d2f1b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:35.146587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:35.217305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b337c1-34ca-4c9a-9214-02443e7d2f1b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:35.252144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c8204-e995-402b-bd40-51d6448582f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:35.252834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c8204-e995-402b-bd40-51d6448582f3 None admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:35.253119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c8204-e995-402b-bd40-51d6448582f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:35.253398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c8204-e995-402b-bd40-51d6448582f3 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:35.254127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c8204-e995-402b-bd40-51d6448582f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:35.255501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c8204-e995-402b-bd40-51d6448582f3 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:35.362732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 645/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Thu Jun 2 13:36:35 2022] POST /identity/v3/services => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:37.631017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b545-dbed-4a0c-9bed-21cccb2cdc67 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.631565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b545-dbed-4a0c-9bed-21cccb2cdc67 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.631661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4b545-dbed-4a0c-9bed-21cccb2cdc67 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.633585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 651/1296] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:37.638766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6638cb7-a62e-4850-bb88-77fdf8ac003e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.639178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6638cb7-a62e-4850-bb88-77fdf8ac003e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.639329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6638cb7-a62e-4850-bb88-77fdf8ac003e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.655717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d6638cb7-a62e-4850-bb88-77fdf8ac003e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:37.656920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d6638cb7-a62e-4850-bb88-77fdf8ac003e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:37.728566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 646/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:37.751397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b545-dbed-4a0c-9bed-21cccb2cdc67 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.849279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4b545-dbed-4a0c-9bed-21cccb2cdc67 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:37.882930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:37.883711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:37.883992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:37.884266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:37.884939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:37.886287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:37.898239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:37.902189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:37.903373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 652/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:37.905808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6638cb7-a62e-4850-bb88-77fdf8ac003e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:37.924373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.008326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6638cb7-a62e-4850-bb88-77fdf8ac003e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.044167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.044863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.045153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.045437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.046144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:38.046485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.047874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.053182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 647/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 2 13:36:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:38.060118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.090668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.157846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c76dca-f8d4-48e7-866d-b88d44babccd None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.191050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522f6af1-d262-4bdb-9c87-4241af93f0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.191702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f6af1-d262-4bdb-9c87-4241af93f0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.191997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f6af1-d262-4bdb-9c87-4241af93f0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.192279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522f6af1-d262-4bdb-9c87-4241af93f0d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.193110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f6af1-d262-4bdb-9c87-4241af93f0d1 None admin] RBAC: Adding query filter params (interface=public, service_id=e5997c8c98bc4a5b94e9e17043183dad, region_id=RegionOne) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:38.193434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f6af1-d262-4bdb-9c87-4241af93f0d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.194847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522f6af1-d262-4bdb-9c87-4241af93f0d1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.199793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 653/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/endpoints?service_id=e5997c8c98bc4a5b94e9e17043183dad&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:38.205453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:38.287493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:38.306096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2bce48-0d32-417d-817b-d46d43cc8165 None admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:38.349073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e461e0b-eb7e-4309-8add-5a1764f2c8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:38.349773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461e0b-eb7e-4309-8add-5a1764f2c8ab None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:38.350072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461e0b-eb7e-4309-8add-5a1764f2c8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:38.350355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e461e0b-eb7e-4309-8add-5a1764f2c8ab None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:38.352190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e461e0b-eb7e-4309-8add-5a1764f2c8ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:38.353634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e461e0b-eb7e-4309-8add-5a1764f2c8ab None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:38.361241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 648/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Thu Jun 2 13:36:38 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:36:40.658215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7b159-0e0d-4f8b-8229-2cd604962c6e None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.658806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7b159-0e0d-4f8b-8229-2cd604962c6e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.658806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7b159-0e0d-4f8b-8229-2cd604962c6e None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.660136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 654/1302] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:36:40.666080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633561-34de-414c-b6ad-91c35e1e4f09 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.666520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633561-34de-414c-b6ad-91c35e1e4f09 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.666666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43633561-34de-414c-b6ad-91c35e1e4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.682859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-43633561-34de-414c-b6ad-91c35e1e4f09 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:36:40.684082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-43633561-34de-414c-b6ad-91c35e1e4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:36:40.750892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 649/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:36:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 02 13:36:40.774094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7b159-0e0d-4f8b-8229-2cd604962c6e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:40.872024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:40.878818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7b159-0e0d-4f8b-8229-2cd604962c6e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:40.911125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:40.911912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:40.912199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:40.912507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:40.913698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:40.915245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 02 13:36:40.926823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 02 13:36:40.931597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.get_or_create( Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application with Lock( Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self._enter() Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application return self.creator() Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application created_value = creator( Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: ERROR keystone.server.flask.application Jun 02 13:36:40.932798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 655/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 02 13:36:40.934921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43633561-34de-414c-b6ad-91c35e1e4f09 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.011630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:41.033525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43633561-34de-414c-b6ad-91c35e1e4f09 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.067478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bf00c-47cf-4a84-a4d0-c4a18663b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.068136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bf00c-47cf-4a84-a4d0-c4a18663b3ef None admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.068446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bf00c-47cf-4a84-a4d0-c4a18663b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.068734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bf00c-47cf-4a84-a4d0-c4a18663b3ef None admin] PATH_INFO: `/v3/services` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.069785 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bf00c-47cf-4a84-a4d0-c4a18663b3ef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:36:41.069965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bf00c-47cf-4a84-a4d0-c4a18663b3ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.071361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bf00c-47cf-4a84-a4d0-c4a18663b3ef None admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.076701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 650/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Thu Jun 2 13:36:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:36:41.082063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:36:41.185286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823c43d-df1d-4905-8c72-f1d77f66817b None admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:36:41.219027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a53522-2a5b-4b51-882a-11715919efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:36:41.219669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53522-2a5b-4b51-882a-11715919efd1 None admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:36:41.219952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53522-2a5b-4b51-882a-11715919efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:36:41.220231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a53522-2a5b-4b51-882a-11715919efd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:36:41.221002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a53522-2a5b-4b51-882a-11715919efd1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:36:41.222376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a53522-2a5b-4b51-882a-11715919efd1 None admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:36:41.297881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 656/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Thu Jun 2 13:36:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:36:51.122380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=30 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:36:51.293298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:31.254861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b374-178d-4316-b063-b212a2a4e04e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:31.255416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b374-178d-4316-b063-b212a2a4e04e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:31.255416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e965b374-178d-4316-b063-b212a2a4e04e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:31.262501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2439-cb90-492d-ba29-f15b89b16f74 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:31.262961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2439-cb90-492d-ba29-f15b89b16f74 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:31.263082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae2439-cb90-492d-ba29-f15b89b16f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:31.266300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 651/1307] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:31.359958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-05ae2439-cb90-492d-ba29-f15b89b16f74 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:31.361207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-05ae2439-cb90-492d-ba29-f15b89b16f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:31.483256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 657/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:44:31.535398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7f4f-05a8-4aa2-81e4-6e333417a968 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:31.535739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7f4f-05a8-4aa2-81e4-6e333417a968 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:31.535961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6a7f4f-05a8-4aa2-81e4-6e333417a968 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:31.537529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 652/1309] 10.222.0.33 () {54 vars in 964 bytes} [Thu Jun 2 13:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:31.545525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa23a8-7e43-45b5-b9ad-c4eac162224d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:31.545889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa23a8-7e43-45b5-b9ad-c4eac162224d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:31.546296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa23a8-7e43-45b5-b9ad-c4eac162224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:31.659482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-baaa23a8-7e43-45b5-b9ad-c4eac162224d None None] MFA Rules not processed for user `d7b2b76c46b640c0b19b46ed50d333ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:31.661090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-baaa23a8-7e43-45b5-b9ad-c4eac162224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:31.692446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:31.774282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 658/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Jun 2 13:44:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:31.784489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a7f4f-05a8-4aa2-81e4-6e333417a968 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:31.786609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5d6a7f4f-05a8-4aa2-81e4-6e333417a968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:31.908315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6a7f4f-05a8-4aa2-81e4-6e333417a968 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:31.987142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5079adcf-14de-43bc-a01d-7e73a9f76290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:31.987800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079adcf-14de-43bc-a01d-7e73a9f76290 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:31.988088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079adcf-14de-43bc-a01d-7e73a9f76290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:31.988368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079adcf-14de-43bc-a01d-7e73a9f76290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:31.990043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5079adcf-14de-43bc-a01d-7e73a9f76290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:32.063241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:32.119402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079adcf-14de-43bc-a01d-7e73a9f76290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:32.121043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5079adcf-14de-43bc-a01d-7e73a9f76290 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:32.142111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 653/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:34.740758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ce21-ee9e-45ae-a9fa-d9a744dd3548 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.742400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ce21-ee9e-45ae-a9fa-d9a744dd3548 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.742400 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c8ce21-ee9e-45ae-a9fa-d9a744dd3548 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.743621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 659/1312] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:34.749826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba0f6-2fe8-4ab8-95aa-93f014de0910 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:34.750360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba0f6-2fe8-4ab8-95aa-93f014de0910 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:34.750460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ba0f6-2fe8-4ab8-95aa-93f014de0910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:34.828266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ca6ba0f6-2fe8-4ab8-95aa-93f014de0910 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:34.829557 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ca6ba0f6-2fe8-4ab8-95aa-93f014de0910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:35.070566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 654/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:35.109224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8ce21-ee9e-45ae-a9fa-d9a744dd3548 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:35.110772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e8c8ce21-ee9e-45ae-a9fa-d9a744dd3548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:35.216164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c8ce21-ee9e-45ae-a9fa-d9a744dd3548 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:35.290539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:35.293233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39082f2-0b7f-43b0-8dee-3a51a5a0f99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:35.293890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39082f2-0b7f-43b0-8dee-3a51a5a0f99b service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:35.294179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39082f2-0b7f-43b0-8dee-3a51a5a0f99b service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:35.294528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39082f2-0b7f-43b0-8dee-3a51a5a0f99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:35.296342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e39082f2-0b7f-43b0-8dee-3a51a5a0f99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:35.410707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39082f2-0b7f-43b0-8dee-3a51a5a0f99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:35.412160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39082f2-0b7f-43b0-8dee-3a51a5a0f99b service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:35.430471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 660/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:38.453852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c294d1-213b-430e-8c5c-d8919bfaee1e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:38.454396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c294d1-213b-430e-8c5c-d8919bfaee1e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:38.454396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c294d1-213b-430e-8c5c-d8919bfaee1e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:38.455782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 655/1315] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:38.462029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8584e6-b2a1-45bd-9152-9d294b7930ef None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:38.462466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8584e6-b2a1-45bd-9152-9d294b7930ef None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:38.462593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8584e6-b2a1-45bd-9152-9d294b7930ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:38.531727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ed8584e6-b2a1-45bd-9152-9d294b7930ef None None] MFA Rules not processed for user `e8bebc31076d42a2a93c43de34687d79`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:38.532977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ed8584e6-b2a1-45bd-9152-9d294b7930ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:38.587031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:38.634218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 661/1316] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:38 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:38.674430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c294d1-213b-430e-8c5c-d8919bfaee1e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:38.676042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-71c294d1-213b-430e-8c5c-d8919bfaee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:38.685860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:38.782009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c294d1-213b-430e-8c5c-d8919bfaee1e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:38.856688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a875d6f3-15a6-4bc3-9067-ff9b731e9e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:38.857326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875d6f3-15a6-4bc3-9067-ff9b731e9e16 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:38.857605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875d6f3-15a6-4bc3-9067-ff9b731e9e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:38.857876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a875d6f3-15a6-4bc3-9067-ff9b731e9e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:38.859495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a875d6f3-15a6-4bc3-9067-ff9b731e9e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:38.923197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:38.969928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875d6f3-15a6-4bc3-9067-ff9b731e9e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:38.971360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a875d6f3-15a6-4bc3-9067-ff9b731e9e16 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:38.989483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 656/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:38 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:42.123609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132001-c264-426c-b3dc-f225d9d83aa0 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.124163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132001-c264-426c-b3dc-f225d9d83aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.124163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54132001-c264-426c-b3dc-f225d9d83aa0 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.125651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 662/1318] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:42.130936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ffe70-159f-4fa7-9c88-beb1fd71cdb7 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.131409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ffe70-159f-4fa7-9c88-beb1fd71cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.140662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ffe70-159f-4fa7-9c88-beb1fd71cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.195283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d83ffe70-159f-4fa7-9c88-beb1fd71cdb7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:42.196538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d83ffe70-159f-4fa7-9c88-beb1fd71cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.294550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 657/1319] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:42.348593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7725b7-bd91-4af3-98a2-1dd84ede5c93 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.348886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7725b7-bd91-4af3-98a2-1dd84ede5c93 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.349163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7725b7-bd91-4af3-98a2-1dd84ede5c93 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.351791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 663/1320] 10.222.0.33 () {54 vars in 964 bytes} [Thu Jun 2 13:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:42.357739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31403a-9df9-4064-9915-38ddc889ae70 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.358036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31403a-9df9-4064-9915-38ddc889ae70 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.358320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31403a-9df9-4064-9915-38ddc889ae70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.378480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:42.432220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-9d31403a-9df9-4064-9915-38ddc889ae70 None None] MFA Rules not processed for user `d7b2b76c46b640c0b19b46ed50d333ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:42.433787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9d31403a-9df9-4064-9915-38ddc889ae70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.509560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 658/1321] 10.222.0.33 () {58 vars in 1061 bytes} [Thu Jun 2 13:44:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:42.518597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7725b7-bd91-4af3-98a2-1dd84ede5c93 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:42.520159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9a7725b7-bd91-4af3-98a2-1dd84ede5c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.623210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7725b7-bd91-4af3-98a2-1dd84ede5c93 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:42.694372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deef2af-46ae-46f2-97be-1c6cc0f21617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:42.694933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deef2af-46ae-46f2-97be-1c6cc0f21617 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:42.695218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deef2af-46ae-46f2-97be-1c6cc0f21617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:42.695494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deef2af-46ae-46f2-97be-1c6cc0f21617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:42.697151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8deef2af-46ae-46f2-97be-1c6cc0f21617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:42.704323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:42.807688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deef2af-46ae-46f2-97be-1c6cc0f21617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:42.809150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deef2af-46ae-46f2-97be-1c6cc0f21617 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:42.827232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 664/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:46.813562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebbb7-5a1a-4684-8a61-bf8accea46f0 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.814061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebbb7-5a1a-4684-8a61-bf8accea46f0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.814061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcebbb7-5a1a-4684-8a61-bf8accea46f0 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.815412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 659/1323] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:46.820906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e1d2-ba59-4dbf-9e38-716cdc7dbd04 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:46.821415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e1d2-ba59-4dbf-9e38-716cdc7dbd04 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:46.821513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158e1d2-ba59-4dbf-9e38-716cdc7dbd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:46.885264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0158e1d2-ba59-4dbf-9e38-716cdc7dbd04 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:46.886456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0158e1d2-ba59-4dbf-9e38-716cdc7dbd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:46.979667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:47.017948 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 665/1324] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:47.055163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebbb7-5a1a-4684-8a61-bf8accea46f0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:47.056729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1dcebbb7-5a1a-4684-8a61-bf8accea46f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:47.163873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcebbb7-5a1a-4684-8a61-bf8accea46f0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:47.176197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:47.237937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f2e90-3f8d-474a-bbc6-8aaf10effbe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:47.238581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2e90-3f8d-474a-bbc6-8aaf10effbe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:47.238867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2e90-3f8d-474a-bbc6-8aaf10effbe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:47.239145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f2e90-3f8d-474a-bbc6-8aaf10effbe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:47.241019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-879f2e90-3f8d-474a-bbc6-8aaf10effbe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:47.357946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f2e90-3f8d-474a-bbc6-8aaf10effbe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:47.359399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f2e90-3f8d-474a-bbc6-8aaf10effbe1 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:47.377456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 660/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:49.779209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cdfcd-ddeb-406a-bd00-83173d8f5a08 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.779650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cdfcd-ddeb-406a-bd00-83173d8f5a08 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.785223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cdfcd-ddeb-406a-bd00-83173d8f5a08 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.785223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 666/1326] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:49.786469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15085b4d-3fb5-44f2-8e04-f20d26f24f9b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:49.786892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15085b4d-3fb5-44f2-8e04-f20d26f24f9b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:49.787033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15085b4d-3fb5-44f2-8e04-f20d26f24f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:49.837651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:49.856160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-15085b4d-3fb5-44f2-8e04-f20d26f24f9b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:49.857388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-15085b4d-3fb5-44f2-8e04-f20d26f24f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:49.968474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 661/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:50.005622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cdfcd-ddeb-406a-bd00-83173d8f5a08 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:50.007297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ac7cdfcd-ddeb-406a-bd00-83173d8f5a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:50.113954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cdfcd-ddeb-406a-bd00-83173d8f5a08 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:50.187311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796777fd-b978-47ee-947f-035fde6e8663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:50.187953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796777fd-b978-47ee-947f-035fde6e8663 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:50.188236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796777fd-b978-47ee-947f-035fde6e8663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:50.188550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796777fd-b978-47ee-947f-035fde6e8663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:50.190232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-796777fd-b978-47ee-947f-035fde6e8663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:50.208355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:50.305535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796777fd-b978-47ee-947f-035fde6e8663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:50.306979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796777fd-b978-47ee-947f-035fde6e8663 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:50.325684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 667/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:52.677199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504513-5ed7-4246-8eb6-d709b48cef22 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.677847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504513-5ed7-4246-8eb6-d709b48cef22 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.677847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4504513-5ed7-4246-8eb6-d709b48cef22 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.679113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 662/1329] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:52.684581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfec22-63b5-47c5-8825-a26e974ba649 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:52.685014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfec22-63b5-47c5-8825-a26e974ba649 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:52.685278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfec22-63b5-47c5-8825-a26e974ba649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:52.750134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d2bfec22-63b5-47c5-8825-a26e974ba649 None None] MFA Rules not processed for user `e8bebc31076d42a2a93c43de34687d79`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:52.751214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d2bfec22-63b5-47c5-8825-a26e974ba649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:52.815656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:52.847517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 668/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:52.884554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504513-5ed7-4246-8eb6-d709b48cef22 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:52.886144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b4504513-5ed7-4246-8eb6-d709b48cef22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:52.989983 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4504513-5ed7-4246-8eb6-d709b48cef22 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:53.009819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:53.063991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdfd4d4-321d-46f5-8594-8566c7c8568f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:53.064683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd4d4-321d-46f5-8594-8566c7c8568f service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:53.064964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd4d4-321d-46f5-8594-8566c7c8568f service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:53.065247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdfd4d4-321d-46f5-8594-8566c7c8568f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:53.066895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1bdfd4d4-321d-46f5-8594-8566c7c8568f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:53.180822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfd4d4-321d-46f5-8594-8566c7c8568f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:53.182280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdfd4d4-321d-46f5-8594-8566c7c8568f service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:53.200344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 663/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:56.048001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f028-6ebc-4520-8f3d-839e8a058afd None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:56.053122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f028-6ebc-4520-8f3d-839e8a058afd None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:56.053122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387f028-6ebc-4520-8f3d-839e8a058afd None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:56.053122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 669/1332] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:56.056827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5f2d-55a2-4078-82f3-515b61f192eb None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:56.057315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5f2d-55a2-4078-82f3-515b61f192eb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:56.061566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b5f2d-55a2-4078-82f3-515b61f192eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:56.150127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:56.152913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-207b5f2d-55a2-4078-82f3-515b61f192eb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:56.154379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-207b5f2d-55a2-4078-82f3-515b61f192eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:56.282824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 664/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:56.322007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f028-6ebc-4520-8f3d-839e8a058afd None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:56.324117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5387f028-6ebc-4520-8f3d-839e8a058afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:56.430872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387f028-6ebc-4520-8f3d-839e8a058afd None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:56.507254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc5a51-3bfe-491a-9266-182f81b6f260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:56.507846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5a51-3bfe-491a-9266-182f81b6f260 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:56.508135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5a51-3bfe-491a-9266-182f81b6f260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:56.508443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc5a51-3bfe-491a-9266-182f81b6f260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:56.510108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fccc5a51-3bfe-491a-9266-182f81b6f260 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:56.538963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:56.622445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc5a51-3bfe-491a-9266-182f81b6f260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:56.623997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc5a51-3bfe-491a-9266-182f81b6f260 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:56.642378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 670/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:44:58.963779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfc9f5-2ce4-440f-906c-a8b7bb841358 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:58.964308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfc9f5-2ce4-440f-906c-a8b7bb841358 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:58.964431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfc9f5-2ce4-440f-906c-a8b7bb841358 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:58.965734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 665/1335] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:44:58.970982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc913a8-8046-4e37-aaac-6ffb7473cb52 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:58.971409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc913a8-8046-4e37-aaac-6ffb7473cb52 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:58.971545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc913a8-8046-4e37-aaac-6ffb7473cb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:59.034810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-edc913a8-8046-4e37-aaac-6ffb7473cb52 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:44:59.036010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-edc913a8-8046-4e37-aaac-6ffb7473cb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:59.108920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:59.131348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 671/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:44:59.172518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfc9f5-2ce4-440f-906c-a8b7bb841358 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:44:59.174063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a5bfc9f5-2ce4-440f-906c-a8b7bb841358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:59.278985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfc9f5-2ce4-440f-906c-a8b7bb841358 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:44:59.306583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:44:59.352370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b24d5-1473-40d8-a857-837da9d9636e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:44:59.353031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b24d5-1473-40d8-a857-837da9d9636e service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:44:59.353316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b24d5-1473-40d8-a857-837da9d9636e service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:44:59.353598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b24d5-1473-40d8-a857-837da9d9636e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:44:59.355238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-483b24d5-1473-40d8-a857-837da9d9636e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:44:59.465854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b24d5-1473-40d8-a857-837da9d9636e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:44:59.467287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b24d5-1473-40d8-a857-837da9d9636e service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:44:59.485297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 666/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:45:02.718298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa88f-b0a9-46ea-a20d-e535aef72490 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:02.718890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa88f-b0a9-46ea-a20d-e535aef72490 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:02.718890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa88f-b0a9-46ea-a20d-e535aef72490 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:02.720240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 672/1338] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:02.725871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0200-5d68-4179-8127-ddd81a83c273 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:02.726336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0200-5d68-4179-8127-ddd81a83c273 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:02.726469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0200-5d68-4179-8127-ddd81a83c273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:02.803714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-178f0200-5d68-4179-8127-ddd81a83c273 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:02.804880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-178f0200-5d68-4179-8127-ddd81a83c273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:02.813391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:02.907028 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 667/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:02.942890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfa88f-b0a9-46ea-a20d-e535aef72490 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:02.945706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e7bfa88f-b0a9-46ea-a20d-e535aef72490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:03.044071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfa88f-b0a9-46ea-a20d-e535aef72490 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:03.047771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbde8f-aee5-469e-9b30-43c386843938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:03.048454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbde8f-aee5-469e-9b30-43c386843938 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:03.048741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbde8f-aee5-469e-9b30-43c386843938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:03.049017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbde8f-aee5-469e-9b30-43c386843938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:03.058787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbde8f-aee5-469e-9b30-43c386843938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:03.060212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbde8f-aee5-469e-9b30-43c386843938 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:03.069715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 673/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:07.892369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f859b-6788-4536-9c64-7b5b89d02160 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:07.892901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f859b-6788-4536-9c64-7b5b89d02160 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:07.892994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f859b-6788-4536-9c64-7b5b89d02160 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:07.894372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 668/1341] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:07.900945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56b55-6ccf-4187-ba91-2f6bb67b08f7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:07.901397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56b55-6ccf-4187-ba91-2f6bb67b08f7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:07.901679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f56b55-6ccf-4187-ba91-2f6bb67b08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:07.930899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-55f56b55-6ccf-4187-ba91-2f6bb67b08f7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:07.932228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-55f56b55-6ccf-4187-ba91-2f6bb67b08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:08.017841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 674/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:08.058598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f859b-6788-4536-9c64-7b5b89d02160 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:08.060419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-021f859b-6788-4536-9c64-7b5b89d02160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:08.074080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f859b-6788-4536-9c64-7b5b89d02160 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:08.077781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e70c2-0e60-415b-b84d-f21b701bc79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:08.078441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e70c2-0e60-415b-b84d-f21b701bc79b service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:08.078731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e70c2-0e60-415b-b84d-f21b701bc79b service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:08.079010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e70c2-0e60-415b-b84d-f21b701bc79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:08.089200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e70c2-0e60-415b-b84d-f21b701bc79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:08.090652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e70c2-0e60-415b-b84d-f21b701bc79b service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:08.100456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 669/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:11.612937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65136769-313e-46dd-a66d-e1ce98cc42af None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:11.613452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65136769-313e-46dd-a66d-e1ce98cc42af None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:11.613551 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65136769-313e-46dd-a66d-e1ce98cc42af None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:11.614969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 675/1344] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:11.620240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf072b5-79ac-4e43-afdd-f401ca8e8bfa None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:11.620714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf072b5-79ac-4e43-afdd-f401ca8e8bfa None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:11.620843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf072b5-79ac-4e43-afdd-f401ca8e8bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:11.638559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-cdf072b5-79ac-4e43-afdd-f401ca8e8bfa None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:11.639777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-cdf072b5-79ac-4e43-afdd-f401ca8e8bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:11.648513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 670/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:11.686138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65136769-313e-46dd-a66d-e1ce98cc42af None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:11.697437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65136769-313e-46dd-a66d-e1ce98cc42af None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:11.700993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8ba10-f7c1-4663-b176-a630eb34dab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:11.701640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ba10-f7c1-4663-b176-a630eb34dab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:11.701928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ba10-f7c1-4663-b176-a630eb34dab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:11.702209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8ba10-f7c1-4663-b176-a630eb34dab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:11.712457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8ba10-f7c1-4663-b176-a630eb34dab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:11.713901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8ba10-f7c1-4663-b176-a630eb34dab4 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:11.723603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 676/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:16.569100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb25d5-c227-4dab-ac97-615a36e4c6d2 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:16.569630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb25d5-c227-4dab-ac97-615a36e4c6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:16.569783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb25d5-c227-4dab-ac97-615a36e4c6d2 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:16.571183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 671/1347] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:16.576562 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e70c-6859-4030-ac91-4a7a5645bc8d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:16.576985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e70c-6859-4030-ac91-4a7a5645bc8d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:16.577127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797e70c-6859-4030-ac91-4a7a5645bc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:16.596171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9797e70c-6859-4030-ac91-4a7a5645bc8d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:16.597392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9797e70c-6859-4030-ac91-4a7a5645bc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:16.605920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 677/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:16.643474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb25d5-c227-4dab-ac97-615a36e4c6d2 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:16.654448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb25d5-c227-4dab-ac97-615a36e4c6d2 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:16.657976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f5cf8-efd7-449b-82b3-87e3f05d754b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:16.658606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f5cf8-efd7-449b-82b3-87e3f05d754b service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:16.658893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f5cf8-efd7-449b-82b3-87e3f05d754b service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:16.659172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f5cf8-efd7-449b-82b3-87e3f05d754b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:16.669004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f5cf8-efd7-449b-82b3-87e3f05d754b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:16.670424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f5cf8-efd7-449b-82b3-87e3f05d754b service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:16.680676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 672/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:22.263098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d8cf-3aa3-49d9-89ce-15cc575f6cd5 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:22.263600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d8cf-3aa3-49d9-89ce-15cc575f6cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:22.263683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421d8cf-3aa3-49d9-89ce-15cc575f6cd5 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:22.265055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 678/1350] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:22.270022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fac86-b703-432f-8cfd-d35198212344 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:22.270477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fac86-b703-432f-8cfd-d35198212344 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:22.270640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56fac86-b703-432f-8cfd-d35198212344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:22.349708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b56fac86-b703-432f-8cfd-d35198212344 None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:22.351980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b56fac86-b703-432f-8cfd-d35198212344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:22.422427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:22.448295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 673/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:45:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:26.589814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:26.865946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917ad5-eca3-419e-8516-8b12bef608fd None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:26.868877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917ad5-eca3-419e-8516-8b12bef608fd None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:26.869172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41917ad5-eca3-419e-8516-8b12bef608fd None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:26.870976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 679/1352] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:45:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:26.877744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0149-9782-4875-8890-6b3926c7e497 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:26.878276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0149-9782-4875-8890-6b3926c7e497 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:26.880980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0149-9782-4875-8890-6b3926c7e497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:26.900863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d15f0149-9782-4875-8890-6b3926c7e497 None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:26.902112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d15f0149-9782-4875-8890-6b3926c7e497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:26.911045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 674/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:45:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:28.635414 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017aaed-50dc-493f-86d9-175e50d95cfd None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:28.635912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017aaed-50dc-493f-86d9-175e50d95cfd None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:28.635912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017aaed-50dc-493f-86d9-175e50d95cfd None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:28.637494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 680/1354] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:28.642876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089273-007c-473e-bbc9-80a3a926415d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:28.643314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089273-007c-473e-bbc9-80a3a926415d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:28.643455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3089273-007c-473e-bbc9-80a3a926415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:28.662408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a3089273-007c-473e-bbc9-80a3a926415d None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:28.663725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a3089273-007c-473e-bbc9-80a3a926415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:28.672240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 675/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:45:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:32.436059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b2f57-482b-4c06-813d-65fe03f1883c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.436625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b2f57-482b-4c06-813d-65fe03f1883c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.436625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b2f57-482b-4c06-813d-65fe03f1883c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.438040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 681/1356] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:32.443848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236fce8-5031-4c2c-b4a5-09634f3b0c3b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.444272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236fce8-5031-4c2c-b4a5-09634f3b0c3b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.444444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236fce8-5031-4c2c-b4a5-09634f3b0c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.463074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d236fce8-5031-4c2c-b4a5-09634f3b0c3b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:32.464264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d236fce8-5031-4c2c-b4a5-09634f3b0c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:32.476762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 676/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:32.532373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610aa6f-117d-47b4-bc83-b1e261f25b9e None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.533056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610aa6f-117d-47b4-bc83-b1e261f25b9e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.533547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610aa6f-117d-47b4-bc83-b1e261f25b9e None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.536699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 682/1358] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 2 13:45:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:32.555540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689be44-f7a5-492d-abae-27c0a2569767 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.555980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689be44-f7a5-492d-abae-27c0a2569767 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.556365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c689be44-f7a5-492d-abae-27c0a2569767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.608858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c689be44-f7a5-492d-abae-27c0a2569767 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:32.610234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c689be44-f7a5-492d-abae-27c0a2569767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:32.702526 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 677/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 2 13:45:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:32.712064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610aa6f-117d-47b4-bc83-b1e261f25b9e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:32.727678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610aa6f-117d-47b4-bc83-b1e261f25b9e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:32.733332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5fcfb9-135f-4739-b71a-d945addf8a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:32.734070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fcfb9-135f-4739-b71a-d945addf8a7a service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:32.734513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fcfb9-135f-4739-b71a-d945addf8a7a service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:32.734891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5fcfb9-135f-4739-b71a-d945addf8a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:32.743665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fcfb9-135f-4739-b71a-d945addf8a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:32.745405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5fcfb9-135f-4739-b71a-d945addf8a7a service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:32.755405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 683/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:35.291230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc3ae-39a9-4861-81c5-f1f95aebfb08 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.291774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc3ae-39a9-4861-81c5-f1f95aebfb08 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.291774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc3ae-39a9-4861-81c5-f1f95aebfb08 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.293203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 678/1361] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:35.298578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915779e2-517b-4572-b32e-d6497e591bb7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.299002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915779e2-517b-4572-b32e-d6497e591bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.299202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915779e2-517b-4572-b32e-d6497e591bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.317922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-915779e2-517b-4572-b32e-d6497e591bb7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:35.319274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-915779e2-517b-4572-b32e-d6497e591bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:35.327530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 684/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:35.373375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecc3ae-39a9-4861-81c5-f1f95aebfb08 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:35.388056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ecc3ae-39a9-4861-81c5-f1f95aebfb08 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:35.393882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961e8fa-fdc5-431a-8b2e-b213d2413a66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:35.394594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e8fa-fdc5-431a-8b2e-b213d2413a66 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:35.394954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e8fa-fdc5-431a-8b2e-b213d2413a66 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:35.395296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961e8fa-fdc5-431a-8b2e-b213d2413a66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:35.403972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961e8fa-fdc5-431a-8b2e-b213d2413a66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:35.405697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961e8fa-fdc5-431a-8b2e-b213d2413a66 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:35.416181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 679/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:38.252176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc66c5-5282-4605-89e5-416b7fd4a6ee None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.252800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc66c5-5282-4605-89e5-416b7fd4a6ee None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.252800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc66c5-5282-4605-89e5-416b7fd4a6ee None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.254822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 685/1364] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:38.260257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0b1a-17ba-4fd9-bcce-ea4bd689b65d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.260842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0b1a-17ba-4fd9-bcce-ea4bd689b65d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.261024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b0b1a-17ba-4fd9-bcce-ea4bd689b65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.281340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e33b0b1a-17ba-4fd9-bcce-ea4bd689b65d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:38.283391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e33b0b1a-17ba-4fd9-bcce-ea4bd689b65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:38.297067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 680/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:38.345586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927d85-0594-4913-b8d7-4a4295a1f995 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.345958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927d85-0594-4913-b8d7-4a4295a1f995 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.346304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a927d85-0594-4913-b8d7-4a4295a1f995 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.347795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 686/1366] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 2 13:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:38.353398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada183c-ee83-4327-a648-e03a5782a863 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.356316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada183c-ee83-4327-a648-e03a5782a863 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.356316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada183c-ee83-4327-a648-e03a5782a863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.372619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-aada183c-ee83-4327-a648-e03a5782a863 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:38.373813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-aada183c-ee83-4327-a648-e03a5782a863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:38.384080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 681/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 2 13:45:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:38.392195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927d85-0594-4913-b8d7-4a4295a1f995 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:38.407749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a927d85-0594-4913-b8d7-4a4295a1f995 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:38.413926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb9974-6816-49f6-b3d3-c50508b33098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:38.414559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb9974-6816-49f6-b3d3-c50508b33098 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:38.414844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb9974-6816-49f6-b3d3-c50508b33098 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:38.415115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb9974-6816-49f6-b3d3-c50508b33098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:38.423271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb9974-6816-49f6-b3d3-c50508b33098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:38.424879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb9974-6816-49f6-b3d3-c50508b33098 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:38.435039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 687/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:40.980874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73985984-c9a8-4af2-a201-a79a466506e2 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.981416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73985984-c9a8-4af2-a201-a79a466506e2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.981534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73985984-c9a8-4af2-a201-a79a466506e2 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:40.983016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 682/1369] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:40.989125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7224cc8-efa3-47a1-8a1f-396a1f5cfe20 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:40.989650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7224cc8-efa3-47a1-8a1f-396a1f5cfe20 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:40.989730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7224cc8-efa3-47a1-8a1f-396a1f5cfe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.009494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d7224cc8-efa3-47a1-8a1f-396a1f5cfe20 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:41.010751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d7224cc8-efa3-47a1-8a1f-396a1f5cfe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:41.021910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 688/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:41.062952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73985984-c9a8-4af2-a201-a79a466506e2 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:41.079646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73985984-c9a8-4af2-a201-a79a466506e2 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:41.085843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1102e-13f3-4032-bc99-32001e059807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:41.086490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1102e-13f3-4032-bc99-32001e059807 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.086777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1102e-13f3-4032-bc99-32001e059807 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.087129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1102e-13f3-4032-bc99-32001e059807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.089091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16638931-32be-4ad2-bf6d-da0372192659 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.089382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16638931-32be-4ad2-bf6d-da0372192659 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.089664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16638931-32be-4ad2-bf6d-da0372192659 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.091082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 689/1371] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:45:41.096835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33127-0f30-44c6-8919-89a3289cc764 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.097325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33127-0f30-44c6-8919-89a3289cc764 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.097452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1102e-13f3-4032-bc99-32001e059807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:41.097895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33127-0f30-44c6-8919-89a3289cc764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.099453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1102e-13f3-4032-bc99-32001e059807 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:41.110402 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 683/1372] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:41.118997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f2e33127-0f30-44c6-8919-89a3289cc764 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:41.120654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f2e33127-0f30-44c6-8919-89a3289cc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:41.130509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 690/1373] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:41.444992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f5df-c441-44fd-b8c1-a717d138bb85 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.444992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f5df-c441-44fd-b8c1-a717d138bb85 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.444992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f5df-c441-44fd-b8c1-a717d138bb85 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.447190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 684/1374] 10.222.0.33 () {54 vars in 963 bytes} [Thu Jun 2 13:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:41.451219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c617d-7319-4591-a9b0-ed70e2ffa97f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.451544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c617d-7319-4591-a9b0-ed70e2ffa97f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.451826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c617d-7319-4591-a9b0-ed70e2ffa97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.511460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0f9c617d-7319-4591-a9b0-ed70e2ffa97f None None] MFA Rules not processed for user `b20a4dea241b4c299fb947b946464ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:41.512787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0f9c617d-7319-4591-a9b0-ed70e2ffa97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:41.585445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 691/1375] 10.222.0.33 () {58 vars in 1060 bytes} [Thu Jun 2 13:45:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:41.593262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f5df-c441-44fd-b8c1-a717d138bb85 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:41.605905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f5df-c441-44fd-b8c1-a717d138bb85 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:41.611414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b82ac-33c4-4317-bdf8-40c761dbba7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:41.611414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b82ac-33c4-4317-bdf8-40c761dbba7f service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:41.611414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b82ac-33c4-4317-bdf8-40c761dbba7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:41.611414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b82ac-33c4-4317-bdf8-40c761dbba7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:41.622379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b82ac-33c4-4317-bdf8-40c761dbba7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:41.624254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b82ac-33c4-4317-bdf8-40c761dbba7f service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:41.637196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 685/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:43.632393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d04ae9-680a-43c4-9f6e-28fe81b1bdd8 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:43.632954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d04ae9-680a-43c4-9f6e-28fe81b1bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:43.632954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d04ae9-680a-43c4-9f6e-28fe81b1bdd8 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:43.634329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 692/1377] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:43.640491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d944b88-c1f7-4878-9aea-8ac0a7e61255 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:43.641089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d944b88-c1f7-4878-9aea-8ac0a7e61255 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:43.641089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d944b88-c1f7-4878-9aea-8ac0a7e61255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:43.660826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-9d944b88-c1f7-4878-9aea-8ac0a7e61255 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:43.662121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9d944b88-c1f7-4878-9aea-8ac0a7e61255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:43.670391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 686/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:43.717334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d04ae9-680a-43c4-9f6e-28fe81b1bdd8 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:43.733087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d04ae9-680a-43c4-9f6e-28fe81b1bdd8 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:43.739370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da2f3c-9e74-4574-abaa-9cc0f5e5047c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:43.740124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2f3c-9e74-4574-abaa-9cc0f5e5047c service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:43.740430 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2f3c-9e74-4574-abaa-9cc0f5e5047c service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:43.740729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da2f3c-9e74-4574-abaa-9cc0f5e5047c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:43.749942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da2f3c-9e74-4574-abaa-9cc0f5e5047c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:43.751572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da2f3c-9e74-4574-abaa-9cc0f5e5047c service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:43.762730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 693/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:46.241421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d150b-6a42-49f4-a832-955258beb86d None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:46.241991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d150b-6a42-49f4-a832-955258beb86d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:46.241991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d150b-6a42-49f4-a832-955258beb86d None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:46.243626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 687/1380] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:46.248752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768128cc-4ad0-427b-b62f-0e6cbcbc56a2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:46.249172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768128cc-4ad0-427b-b62f-0e6cbcbc56a2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:46.249373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768128cc-4ad0-427b-b62f-0e6cbcbc56a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:46.270715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-768128cc-4ad0-427b-b62f-0e6cbcbc56a2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:46.272301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-768128cc-4ad0-427b-b62f-0e6cbcbc56a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:46.281059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 694/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:46.325792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d150b-6a42-49f4-a832-955258beb86d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:46.341153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d150b-6a42-49f4-a832-955258beb86d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:46.346985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba1faf-5606-48a2-870f-ca1b50eb05cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:46.347617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1faf-5606-48a2-870f-ca1b50eb05cf service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:46.347931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1faf-5606-48a2-870f-ca1b50eb05cf service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:46.348206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba1faf-5606-48a2-870f-ca1b50eb05cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:46.356566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba1faf-5606-48a2-870f-ca1b50eb05cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:46.358134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ba1faf-5606-48a2-870f-ca1b50eb05cf service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:46.368290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 688/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:48.843447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabee347-b92b-4206-9cbb-d0094d3127fc None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.844543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabee347-b92b-4206-9cbb-d0094d3127fc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.845057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabee347-b92b-4206-9cbb-d0094d3127fc None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.851448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 695/1383] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:48.852900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51277b-861f-4a9c-820d-65ba23ba555b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.853355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51277b-861f-4a9c-820d-65ba23ba555b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.853555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51277b-861f-4a9c-820d-65ba23ba555b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.868089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:48.875205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0d51277b-861f-4a9c-820d-65ba23ba555b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:48.876547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0d51277b-861f-4a9c-820d-65ba23ba555b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:48.885682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 689/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:48.928692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabee347-b92b-4206-9cbb-d0094d3127fc None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:48.943381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabee347-b92b-4206-9cbb-d0094d3127fc None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:48.949133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3558b7d5-2168-46ec-a7d7-0a94ff73174d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:48.949894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b7d5-2168-46ec-a7d7-0a94ff73174d service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:48.950281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b7d5-2168-46ec-a7d7-0a94ff73174d service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:48.950665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558b7d5-2168-46ec-a7d7-0a94ff73174d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:48.959717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b7d5-2168-46ec-a7d7-0a94ff73174d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:48.961448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3558b7d5-2168-46ec-a7d7-0a94ff73174d service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:48.971348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 696/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:51.299871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a350-da42-40fe-9d43-3fc3cfefe1d5 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.300476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a350-da42-40fe-9d43-3fc3cfefe1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.300663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510a350-da42-40fe-9d43-3fc3cfefe1d5 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.302556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 690/1386] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:51.308494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406373-5a45-40e4-995d-a187e9af4341 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.308926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406373-5a45-40e4-995d-a187e9af4341 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.309223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406373-5a45-40e4-995d-a187e9af4341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.328772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-86406373-5a45-40e4-995d-a187e9af4341 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:51.329985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-86406373-5a45-40e4-995d-a187e9af4341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:51.338928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 697/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:51.384902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a350-da42-40fe-9d43-3fc3cfefe1d5 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:51.402686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510a350-da42-40fe-9d43-3fc3cfefe1d5 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:51.409486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a15e9-ce05-409a-acaa-0df70115c3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:51.410166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a15e9-ce05-409a-acaa-0df70115c3ac service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:51.410517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a15e9-ce05-409a-acaa-0df70115c3ac service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:51.410716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a15e9-ce05-409a-acaa-0df70115c3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:51.421117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a15e9-ce05-409a-acaa-0df70115c3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:51.422722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a15e9-ce05-409a-acaa-0df70115c3ac service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:51.433302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 691/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:53.954444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f1a13-aa43-4d7c-9cf6-9d628f791a88 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:53.954444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f1a13-aa43-4d7c-9cf6-9d628f791a88 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:53.954444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f1a13-aa43-4d7c-9cf6-9d628f791a88 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:53.954444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 698/1389] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:53.958467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b500e3-be52-4678-870d-946a9c75f34a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:53.958856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b500e3-be52-4678-870d-946a9c75f34a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:53.959033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b500e3-be52-4678-870d-946a9c75f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:53.977563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e1b500e3-be52-4678-870d-946a9c75f34a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:53.978800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e1b500e3-be52-4678-870d-946a9c75f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:53.987272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 692/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:45:54.031473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f1a13-aa43-4d7c-9cf6-9d628f791a88 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:54.047103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f1a13-aa43-4d7c-9cf6-9d628f791a88 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:54.053767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae0c18-70f2-4dc1-99f8-888b1d208603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:54.054414 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0c18-70f2-4dc1-99f8-888b1d208603 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:54.054693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0c18-70f2-4dc1-99f8-888b1d208603 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:54.054976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae0c18-70f2-4dc1-99f8-888b1d208603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:54.063516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae0c18-70f2-4dc1-99f8-888b1d208603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:54.065143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae0c18-70f2-4dc1-99f8-888b1d208603 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:54.074800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 699/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:57.344333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23856bf-f9ec-4293-90ff-1ffa2ffd412d None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:57.344934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23856bf-f9ec-4293-90ff-1ffa2ffd412d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:57.344934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23856bf-f9ec-4293-90ff-1ffa2ffd412d None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:57.346283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 693/1392] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:57.351695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1870efb-0e9e-47e9-8daf-a6ff9a689fac None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:57.352148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1870efb-0e9e-47e9-8daf-a6ff9a689fac None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:57.352254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1870efb-0e9e-47e9-8daf-a6ff9a689fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:57.358433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=84 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:57.371041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b1870efb-0e9e-47e9-8daf-a6ff9a689fac None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:57.372293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b1870efb-0e9e-47e9-8daf-a6ff9a689fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:57.381986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 700/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:57.426204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23856bf-f9ec-4293-90ff-1ffa2ffd412d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:57.440683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23856bf-f9ec-4293-90ff-1ffa2ffd412d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:57.447021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21db843-5526-4143-a5e1-bc69b26a8805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:57.447689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db843-5526-4143-a5e1-bc69b26a8805 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:57.447975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db843-5526-4143-a5e1-bc69b26a8805 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:57.448255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21db843-5526-4143-a5e1-bc69b26a8805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:57.457974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db843-5526-4143-a5e1-bc69b26a8805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:57.459497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21db843-5526-4143-a5e1-bc69b26a8805 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:57.469467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 694/1394] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:58.614156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208aec3-593e-4c63-91b9-fa1098264544 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:58.614749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208aec3-593e-4c63-91b9-fa1098264544 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:58.614749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208aec3-593e-4c63-91b9-fa1098264544 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:58.616276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 701/1395] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:58.621685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3675-c93a-4e2b-97d4-1a529cbdae86 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:58.625081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3675-c93a-4e2b-97d4-1a529cbdae86 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:58.625081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c3675-c93a-4e2b-97d4-1a529cbdae86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:58.640702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-576c3675-c93a-4e2b-97d4-1a529cbdae86 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:58.641868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-576c3675-c93a-4e2b-97d4-1a529cbdae86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:58.650759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 695/1396] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:58.707484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c859-125d-4f62-9452-4d08b5e31dd3 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:58.708044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c859-125d-4f62-9452-4d08b5e31dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:58.708332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6c859-125d-4f62-9452-4d08b5e31dd3 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:58.709941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 702/1397] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jun 2 13:45:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:58.714985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9e8a-3e9e-4667-9c44-8cee43bf744f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:58.715282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9e8a-3e9e-4667-9c44-8cee43bf744f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:58.715569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e9e8a-3e9e-4667-9c44-8cee43bf744f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:58.765774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-383e9e8a-3e9e-4667-9c44-8cee43bf744f None None] MFA Rules not processed for user `de8dfe694ffb4716a09db9e1e6d9a9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:58.766981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-383e9e8a-3e9e-4667-9c44-8cee43bf744f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:58.831690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 696/1398] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jun 2 13:45:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:58.840143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6c859-125d-4f62-9452-4d08b5e31dd3 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:58.851278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b6c859-125d-4f62-9452-4d08b5e31dd3 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:58.857141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3e3f49-e664-424d-9783-acb051f02092 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:58.858348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3f49-e664-424d-9783-acb051f02092 service glance] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:58.858813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3f49-e664-424d-9783-acb051f02092 service glance] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:58.859398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3e3f49-e664-424d-9783-acb051f02092 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:58.870854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e3f49-e664-424d-9783-acb051f02092 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:58.872303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3e3f49-e664-424d-9783-acb051f02092 service glance] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:58.882721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 703/1399] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:45:59.631198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1316c55-034f-4a98-b5e3-30b63e504c47 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:59.631759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1316c55-034f-4a98-b5e3-30b63e504c47 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:59.631759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1316c55-034f-4a98-b5e3-30b63e504c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:59.683324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-f1316c55-034f-4a98-b5e3-30b63e504c47 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:59.684610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f1316c55-034f-4a98-b5e3-30b63e504c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:59.748850 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 697/1400] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:45:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:59.795232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf251d-5c80-4703-a082-5e01b495f08f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:59.795691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf251d-5c80-4703-a082-5e01b495f08f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:59.795914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cf251d-5c80-4703-a082-5e01b495f08f None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:59.797429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 704/1401] 10.222.0.33 () {54 vars in 942 bytes} [Thu Jun 2 13:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:45:59.803916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9387-e562-4dcd-91b8-f010e3b994c8 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:59.804235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9387-e562-4dcd-91b8-f010e3b994c8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:59.804569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a9387-e562-4dcd-91b8-f010e3b994c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:59.821510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:45:59.854852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-fc5a9387-e562-4dcd-91b8-f010e3b994c8 None None] MFA Rules not processed for user `4599a196029c4f73b8428250cc19f8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:59.855965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-fc5a9387-e562-4dcd-91b8-f010e3b994c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:59.930263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 698/1402] 10.222.0.33 () {58 vars in 1039 bytes} [Thu Jun 2 13:45:59 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:45:59.939393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf251d-5c80-4703-a082-5e01b495f08f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:45:59.952657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cf251d-5c80-4703-a082-5e01b495f08f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:45:59.958784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:45:59.959436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:59.959726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:59.959884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ce83-c7fd-41cd-a9fa-f10525b8b99e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:59.960007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:59.960180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ce83-c7fd-41cd-a9fa-f10525b8b99e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:59.960487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5ce83-c7fd-41cd-a9fa-f10525b8b99e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:59.961972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 699/1403] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:45:59.966970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a04d4-f4b9-42e3-b29b-ff2056282138 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:45:59.967282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a04d4-f4b9-42e3-b29b-ff2056282138 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:45:59.967565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144a04d4-f4b9-42e3-b29b-ff2056282138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:45:59.968756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:45:59.970347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:45:59.979787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 705/1404] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:45:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:45:59.987200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-144a04d4-f4b9-42e3-b29b-ff2056282138 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:45:59.988631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-144a04d4-f4b9-42e3-b29b-ff2056282138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:45:59.996737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 700/1405] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:46:00.041554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:00.053735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab112247-f273-428c-a948-09820a2c20d4 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:00.059431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd48f36-3fb0-45a1-b272-e2eb3b428732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:00.060057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48f36-3fb0-45a1-b272-e2eb3b428732 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:00.060341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48f36-3fb0-45a1-b272-e2eb3b428732 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:00.060647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd48f36-3fb0-45a1-b272-e2eb3b428732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:00.069303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd48f36-3fb0-45a1-b272-e2eb3b428732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:00.073374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd48f36-3fb0-45a1-b272-e2eb3b428732 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:00.080209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 706/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:02.592151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c59d6e-4066-4cac-b4a1-26461bc3c452 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:02.592732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c59d6e-4066-4cac-b4a1-26461bc3c452 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:02.592732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c59d6e-4066-4cac-b4a1-26461bc3c452 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:02.594540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 701/1407] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:46:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:02.600191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f408-1862-4d52-ba36-357faf5d5a1b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:02.600658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f408-1862-4d52-ba36-357faf5d5a1b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:02.600814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897f408-1862-4d52-ba36-357faf5d5a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:02.624694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7897f408-1862-4d52-ba36-357faf5d5a1b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:02.625917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7897f408-1862-4d52-ba36-357faf5d5a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:02.635315 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 707/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:02.679754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c59d6e-4066-4cac-b4a1-26461bc3c452 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:02.695774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c59d6e-4066-4cac-b4a1-26461bc3c452 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:02.701189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c43c-f0fe-4841-b2ed-1e5058a06747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:02.701825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c43c-f0fe-4841-b2ed-1e5058a06747 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:02.702131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c43c-f0fe-4841-b2ed-1e5058a06747 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:02.702409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c43c-f0fe-4841-b2ed-1e5058a06747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:02.711734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86c43c-f0fe-4841-b2ed-1e5058a06747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:02.713355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86c43c-f0fe-4841-b2ed-1e5058a06747 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:02.726667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 702/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:12.722605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=23 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:12.723731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=49 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:24.710872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169b88-cec0-400c-bc5e-9bdf650ab937 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:24.711486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169b88-cec0-400c-bc5e-9bdf650ab937 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:24.711486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169b88-cec0-400c-bc5e-9bdf650ab937 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:24.712878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 708/1410] 10.222.0.33 () {54 vars in 918 bytes} [Thu Jun 2 13:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:24.717919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f5d6-1cbd-4150-bff1-4a8a54258204 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:24.718386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f5d6-1cbd-4150-bff1-4a8a54258204 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:24.718565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431f5d6-1cbd-4150-bff1-4a8a54258204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:24.736831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3431f5d6-1cbd-4150-bff1-4a8a54258204 None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:24.738035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3431f5d6-1cbd-4150-bff1-4a8a54258204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:24.747039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 703/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 2 13:46:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:24.761006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dda2f-0d3a-4457-8f3e-53a8b3e593a5 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:24.761306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dda2f-0d3a-4457-8f3e-53a8b3e593a5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:24.761591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54dda2f-0d3a-4457-8f3e-53a8b3e593a5 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:24.762947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 709/1412] 10.222.0.33 () {54 vars in 918 bytes} [Thu Jun 2 13:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:24.767297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125cc37-9c7c-43d6-ba19-303f2329b427 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:24.767589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125cc37-9c7c-43d6-ba19-303f2329b427 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:24.767871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8125cc37-9c7c-43d6-ba19-303f2329b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:24.785214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8125cc37-9c7c-43d6-ba19-303f2329b427 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:24.786927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8125cc37-9c7c-43d6-ba19-303f2329b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:24.795898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 704/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Thu Jun 2 13:46:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:27.523185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebbe04-eca6-49cd-a696-2fe9b2652192 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.523667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebbe04-eca6-49cd-a696-2fe9b2652192 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.523790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebbe04-eca6-49cd-a696-2fe9b2652192 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.525132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:27.530370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea4ae-5808-488c-81e2-f17c99373c4e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.530797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea4ae-5808-488c-81e2-f17c99373c4e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.530930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afea4ae-5808-488c-81e2-f17c99373c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.548419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0afea4ae-5808-488c-81e2-f17c99373c4e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:27.549609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0afea4ae-5808-488c-81e2-f17c99373c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:27.557868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:27.600189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebbe04-eca6-49cd-a696-2fe9b2652192 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:27.615565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebbe04-eca6-49cd-a696-2fe9b2652192 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:27.620931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3508d-6032-449d-a18d-bacab67f6ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:27.621564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3508d-6032-449d-a18d-bacab67f6ab7 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:27.621848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3508d-6032-449d-a18d-bacab67f6ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:27.622125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3508d-6032-449d-a18d-bacab67f6ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:27.630844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3508d-6032-449d-a18d-bacab67f6ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:27.632530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3508d-6032-449d-a18d-bacab67f6ab7 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:27.641808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 711/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:28.624519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc26666-1318-4977-b8f5-1c4c512e353e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.625061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc26666-1318-4977-b8f5-1c4c512e353e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.625061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc26666-1318-4977-b8f5-1c4c512e353e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.626412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:28.631867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1970a-c989-4a76-b607-e312e50ab895 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.633905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1970a-c989-4a76-b607-e312e50ab895 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.633905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1970a-c989-4a76-b607-e312e50ab895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.653917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-13b1970a-c989-4a76-b607-e312e50ab895 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:28.655137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-13b1970a-c989-4a76-b607-e312e50ab895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:28.663199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:28.827473 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc26666-1318-4977-b8f5-1c4c512e353e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:28.841717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc26666-1318-4977-b8f5-1c4c512e353e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:28.847110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd1570-62d2-441e-b4e8-ff6d3b20fe34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:28.847912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1570-62d2-441e-b4e8-ff6d3b20fe34 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:28.848204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1570-62d2-441e-b4e8-ff6d3b20fe34 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:28.848526 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1570-62d2-441e-b4e8-ff6d3b20fe34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:28.860220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd1570-62d2-441e-b4e8-ff6d3b20fe34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:28.862477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd1570-62d2-441e-b4e8-ff6d3b20fe34 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:28.873334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 707/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:29.809020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b268d-3e2f-475a-b9df-27dcea198d7b None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.809538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b268d-3e2f-475a-b9df-27dcea198d7b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.809538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b268d-3e2f-475a-b9df-27dcea198d7b None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.810858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:29.815859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d474c-b0cc-47da-a17b-498b6f824e6c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:29.816296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d474c-b0cc-47da-a17b-498b6f824e6c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:29.817020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d474c-b0cc-47da-a17b-498b6f824e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:29.835143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a52d474c-b0cc-47da-a17b-498b6f824e6c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:29.836340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a52d474c-b0cc-47da-a17b-498b6f824e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:29.844066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:29.997183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b268d-3e2f-475a-b9df-27dcea198d7b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:30.011599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b268d-3e2f-475a-b9df-27dcea198d7b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:30.016965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb08794-bed7-4014-adc5-7828d3427b51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:30.017590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08794-bed7-4014-adc5-7828d3427b51 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.017880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08794-bed7-4014-adc5-7828d3427b51 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.018158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb08794-bed7-4014-adc5-7828d3427b51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.026399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb08794-bed7-4014-adc5-7828d3427b51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:30.027970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb08794-bed7-4014-adc5-7828d3427b51 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:30.038124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 714/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:30.946211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278291d9-2f46-4e24-84b8-e6bef9d0b992 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.946755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278291d9-2f46-4e24-84b8-e6bef9d0b992 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.946755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278291d9-2f46-4e24-84b8-e6bef9d0b992 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.948138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:30.953073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4093-e9a6-4486-aaf0-3928e9768c7a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:30.953487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4093-e9a6-4486-aaf0-3928e9768c7a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:30.953678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c4093-e9a6-4486-aaf0-3928e9768c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:30.973092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-571c4093-e9a6-4486-aaf0-3928e9768c7a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:30.974295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-571c4093-e9a6-4486-aaf0-3928e9768c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:30.982132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:31.133222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278291d9-2f46-4e24-84b8-e6bef9d0b992 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:31.147465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278291d9-2f46-4e24-84b8-e6bef9d0b992 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:31.153812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f96d-39be-4aa7-9b52-65d0096c53b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:31.154518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f96d-39be-4aa7-9b52-65d0096c53b9 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:31.154808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f96d-39be-4aa7-9b52-65d0096c53b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:31.155089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f96d-39be-4aa7-9b52-65d0096c53b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:31.163894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f96d-39be-4aa7-9b52-65d0096c53b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:31.165529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f96d-39be-4aa7-9b52-65d0096c53b9 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:31.175508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 710/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:32.085117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d991ae-1758-4067-8076-c8b5277ec6d4 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:32.085657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d991ae-1758-4067-8076-c8b5277ec6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:32.085657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d991ae-1758-4067-8076-c8b5277ec6d4 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:32.087007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:32.092011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dc7de-c33f-4f52-accc-7a941e21b70d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:32.092477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dc7de-c33f-4f52-accc-7a941e21b70d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:32.092628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7dc7de-c33f-4f52-accc-7a941e21b70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:32.111032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2a7dc7de-c33f-4f52-accc-7a941e21b70d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:32.112216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2a7dc7de-c33f-4f52-accc-7a941e21b70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:32.120007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:32.276310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d991ae-1758-4067-8076-c8b5277ec6d4 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:32.294416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d991ae-1758-4067-8076-c8b5277ec6d4 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:32.299740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f064f2-8ebe-4c72-b703-b8707d2a0509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:32.300376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f064f2-8ebe-4c72-b703-b8707d2a0509 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:32.300691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f064f2-8ebe-4c72-b703-b8707d2a0509 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:32.300964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f064f2-8ebe-4c72-b703-b8707d2a0509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:32.308963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f064f2-8ebe-4c72-b703-b8707d2a0509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:32.310521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f064f2-8ebe-4c72-b703-b8707d2a0509 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:32.321508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 717/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:33.306545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1c92e-9dcd-419e-8084-3189a31ec8a6 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:33.307085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1c92e-9dcd-419e-8084-3189a31ec8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:33.307085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1c92e-9dcd-419e-8084-3189a31ec8a6 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:33.308468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:33.313419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643303c-ff84-43eb-92b7-1435ecfd3039 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:33.313821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643303c-ff84-43eb-92b7-1435ecfd3039 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:33.314046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643303c-ff84-43eb-92b7-1435ecfd3039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:33.333442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3643303c-ff84-43eb-92b7-1435ecfd3039 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:33.334646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3643303c-ff84-43eb-92b7-1435ecfd3039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:33.342421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:33.492494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1c92e-9dcd-419e-8084-3189a31ec8a6 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:33.507291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1c92e-9dcd-419e-8084-3189a31ec8a6 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:33.512686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558cea0a-33b9-476b-b586-5e06b4bfc1f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:33.513325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cea0a-33b9-476b-b586-5e06b4bfc1f7 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:33.513610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cea0a-33b9-476b-b586-5e06b4bfc1f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:33.513885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558cea0a-33b9-476b-b586-5e06b4bfc1f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:33.522519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cea0a-33b9-476b-b586-5e06b4bfc1f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:33.524103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558cea0a-33b9-476b-b586-5e06b4bfc1f7 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:33.533400 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 713/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:46:34.460362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e5c6b-4e85-4f9a-9dde-e518fce6345d None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:34.460970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e5c6b-4e85-4f9a-9dde-e518fce6345d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:34.460970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e5c6b-4e85-4f9a-9dde-e518fce6345d None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:34.462327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:34.467338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a64a7f-e698-48bc-9ddb-3bdbe9533f1c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:34.467752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a64a7f-e698-48bc-9ddb-3bdbe9533f1c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:34.467898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a64a7f-e698-48bc-9ddb-3bdbe9533f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:34.486098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b0a64a7f-e698-48bc-9ddb-3bdbe9533f1c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:34.487282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b0a64a7f-e698-48bc-9ddb-3bdbe9533f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:34.495726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:34.645550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e5c6b-4e85-4f9a-9dde-e518fce6345d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:34.659901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e5c6b-4e85-4f9a-9dde-e518fce6345d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:34.666322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c15b2c-b70d-49af-b1f5-4b8c6f558aa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:34.667006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15b2c-b70d-49af-b1f5-4b8c6f558aa2 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:34.667291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15b2c-b70d-49af-b1f5-4b8c6f558aa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:34.667568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c15b2c-b70d-49af-b1f5-4b8c6f558aa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:34.675604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c15b2c-b70d-49af-b1f5-4b8c6f558aa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:34.678030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c15b2c-b70d-49af-b1f5-4b8c6f558aa2 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:34.687272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 720/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:35.620528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c954-b18a-4321-a8e1-2f3ed4fb5f90 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:35.621102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c954-b18a-4321-a8e1-2f3ed4fb5f90 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:35.621102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0c954-b18a-4321-a8e1-2f3ed4fb5f90 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:35.622465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:35.627453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401395-77f1-404b-bcda-5b9584535f9c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:35.627866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401395-77f1-404b-bcda-5b9584535f9c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:35.628043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e401395-77f1-404b-bcda-5b9584535f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:35.646731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-2e401395-77f1-404b-bcda-5b9584535f9c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:35.647938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2e401395-77f1-404b-bcda-5b9584535f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:35.657153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:35.807236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c954-b18a-4321-a8e1-2f3ed4fb5f90 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:35.821729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0c954-b18a-4321-a8e1-2f3ed4fb5f90 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:35.826965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425e217-9ff3-4368-b799-ed7088d2cafc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:35.827585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425e217-9ff3-4368-b799-ed7088d2cafc service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:35.827867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425e217-9ff3-4368-b799-ed7088d2cafc service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:35.828142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425e217-9ff3-4368-b799-ed7088d2cafc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:35.836397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425e217-9ff3-4368-b799-ed7088d2cafc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:35.837999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425e217-9ff3-4368-b799-ed7088d2cafc service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:35.847136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 716/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:36.804807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca23bb-f707-4ad4-b965-897575f68459 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:36.805343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca23bb-f707-4ad4-b965-897575f68459 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:36.805343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca23bb-f707-4ad4-b965-897575f68459 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:36.806755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:36.811697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344ecd6-978d-435f-a38b-cc1cb25378d3 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:36.812085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344ecd6-978d-435f-a38b-cc1cb25378d3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:36.812255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344ecd6-978d-435f-a38b-cc1cb25378d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:36.830089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6344ecd6-978d-435f-a38b-cc1cb25378d3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:36.831317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6344ecd6-978d-435f-a38b-cc1cb25378d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:36.839542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:36.987785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca23bb-f707-4ad4-b965-897575f68459 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:37.002855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca23bb-f707-4ad4-b965-897575f68459 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:37.008091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8115407-cd03-4057-be5a-c8b2b1d0d844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:37.008742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8115407-cd03-4057-be5a-c8b2b1d0d844 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:37.009027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8115407-cd03-4057-be5a-c8b2b1d0d844 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:37.009304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8115407-cd03-4057-be5a-c8b2b1d0d844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:37.017250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8115407-cd03-4057-be5a-c8b2b1d0d844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:37.018823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8115407-cd03-4057-be5a-c8b2b1d0d844 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:37.027983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 723/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:39.152636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec777bb0-eb10-4cc9-8475-e0f7a8b08c0e None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:39.153231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec777bb0-eb10-4cc9-8475-e0f7a8b08c0e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:39.153231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec777bb0-eb10-4cc9-8475-e0f7a8b08c0e None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:39.154566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:39.159994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4896-4cba-41fe-9ab9-e745ca20f3c0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:39.161148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4896-4cba-41fe-9ab9-e745ca20f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:39.161438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4896-4cba-41fe-9ab9-e745ca20f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:39.179547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b95b4896-4cba-41fe-9ab9-e745ca20f3c0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:39.180776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b95b4896-4cba-41fe-9ab9-e745ca20f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:39.188540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:39.227327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec777bb0-eb10-4cc9-8475-e0f7a8b08c0e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:39.237843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec777bb0-eb10-4cc9-8475-e0f7a8b08c0e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:39.242026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0040876-a75a-4725-b115-17c62827b002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:39.242647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0040876-a75a-4725-b115-17c62827b002 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:39.242929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0040876-a75a-4725-b115-17c62827b002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:39.243242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0040876-a75a-4725-b115-17c62827b002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:39.252044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0040876-a75a-4725-b115-17c62827b002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:39.253532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0040876-a75a-4725-b115-17c62827b002 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:39.263092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 719/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:41.687223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fb41c-ef4c-4722-b1b6-0ee61eca242c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:41.687744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fb41c-ef4c-4722-b1b6-0ee61eca242c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:41.687870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3fb41c-ef4c-4722-b1b6-0ee61eca242c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:41.689221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:41.695462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0134-8c97-4780-98d4-cbfae4039f89 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:41.695915 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0134-8c97-4780-98d4-cbfae4039f89 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:41.696012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0134-8c97-4780-98d4-cbfae4039f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:41.713992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ce1e0134-8c97-4780-98d4-cbfae4039f89 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:41.715274 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ce1e0134-8c97-4780-98d4-cbfae4039f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:41.723331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:41.762954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fb41c-ef4c-4722-b1b6-0ee61eca242c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:41.773716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3fb41c-ef4c-4722-b1b6-0ee61eca242c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:41.777248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcbdd7-ab7b-4313-8a53-a9ca08ebe21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:41.777874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcbdd7-ab7b-4313-8a53-a9ca08ebe21d service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:41.778156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcbdd7-ab7b-4313-8a53-a9ca08ebe21d service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:41.778431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcbdd7-ab7b-4313-8a53-a9ca08ebe21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:41.787675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcbdd7-ab7b-4313-8a53-a9ca08ebe21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:41.789169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcbdd7-ab7b-4313-8a53-a9ca08ebe21d service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:41.798654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 726/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:44.468779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5aad-48f1-48b6-b726-4d21d8f25c2f None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.469376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5aad-48f1-48b6-b726-4d21d8f25c2f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.469376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5aad-48f1-48b6-b726-4d21d8f25c2f None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.470716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:44.476457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31ac6-4836-4db4-802c-159eb17a092b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.477000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31ac6-4836-4db4-802c-159eb17a092b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.477107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e31ac6-4836-4db4-802c-159eb17a092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.494650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-41e31ac6-4836-4db4-802c-159eb17a092b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:44.495896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-41e31ac6-4836-4db4-802c-159eb17a092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:44.504307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:44.543246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5aad-48f1-48b6-b726-4d21d8f25c2f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:44.554460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5aad-48f1-48b6-b726-4d21d8f25c2f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:44.557990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67977845-9afd-4dcc-8b61-2c57c49a7d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:44.558617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977845-9afd-4dcc-8b61-2c57c49a7d1d service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:44.558901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977845-9afd-4dcc-8b61-2c57c49a7d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:44.559179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67977845-9afd-4dcc-8b61-2c57c49a7d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:44.568836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67977845-9afd-4dcc-8b61-2c57c49a7d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:44.570266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67977845-9afd-4dcc-8b61-2c57c49a7d1d service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:44.579504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 722/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:47.021718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3021-9f13-496e-95d4-9b4f3fba640b None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:47.022294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3021-9f13-496e-95d4-9b4f3fba640b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:47.022294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a3021-9f13-496e-95d4-9b4f3fba640b None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:47.023640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:47.028919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ead6-9bfc-401c-b9bc-7a588c6273ac None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:47.029347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ead6-9bfc-401c-b9bc-7a588c6273ac None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:47.029467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8ead6-9bfc-401c-b9bc-7a588c6273ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:47.047506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-dee8ead6-9bfc-401c-b9bc-7a588c6273ac None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:47.048848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-dee8ead6-9bfc-401c-b9bc-7a588c6273ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:47.056806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:47.094754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3021-9f13-496e-95d4-9b4f3fba640b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:47.106087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a3021-9f13-496e-95d4-9b4f3fba640b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:47.109562 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6e16a-0c62-4a84-8870-1137f227a642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:47.110190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e16a-0c62-4a84-8870-1137f227a642 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:47.110473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e16a-0c62-4a84-8870-1137f227a642 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:47.110751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6e16a-0c62-4a84-8870-1137f227a642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:47.119533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6e16a-0c62-4a84-8870-1137f227a642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:47.120979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6e16a-0c62-4a84-8870-1137f227a642 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:47.131878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 729/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:49.457233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b253ab-fd1d-4b08-a481-946d57b79ae5 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:49.463582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b253ab-fd1d-4b08-a481-946d57b79ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:49.463582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b253ab-fd1d-4b08-a481-946d57b79ae5 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:49.463582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:49.464676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed74d-cf20-47ed-b8cb-ff464592a810 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:49.465074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed74d-cf20-47ed-b8cb-ff464592a810 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:49.465236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed74d-cf20-47ed-b8cb-ff464592a810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:49.483361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0f9ed74d-cf20-47ed-b8cb-ff464592a810 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:49.484605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0f9ed74d-cf20-47ed-b8cb-ff464592a810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:49.493128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:49.530835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b253ab-fd1d-4b08-a481-946d57b79ae5 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:49.542310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b253ab-fd1d-4b08-a481-946d57b79ae5 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:49.545817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93420ab4-03f4-42a5-9f7c-b727d83385d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:49.546448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420ab4-03f4-42a5-9f7c-b727d83385d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:49.546738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420ab4-03f4-42a5-9f7c-b727d83385d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:49.547022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420ab4-03f4-42a5-9f7c-b727d83385d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:49.556566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93420ab4-03f4-42a5-9f7c-b727d83385d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:49.558011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93420ab4-03f4-42a5-9f7c-b727d83385d5 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:49.568120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 725/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:51.873931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3706-0c3b-4c1b-8cbb-7c213e8cdfd2 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.874460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3706-0c3b-4c1b-8cbb-7c213e8cdfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.874460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3706-0c3b-4c1b-8cbb-7c213e8cdfd2 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.875783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:51.881397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1874-a15f-45e0-b815-e66bfcbbc828 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.881805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1874-a15f-45e0-b815-e66bfcbbc828 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.881962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f1874-a15f-45e0-b815-e66bfcbbc828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.899523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-467f1874-a15f-45e0-b815-e66bfcbbc828 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:51.900754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-467f1874-a15f-45e0-b815-e66bfcbbc828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:51.908538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:51.946774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3706-0c3b-4c1b-8cbb-7c213e8cdfd2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:51.958991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3706-0c3b-4c1b-8cbb-7c213e8cdfd2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:51.962604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620709e8-8404-46da-9a5d-7963316e9dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:51.963234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620709e8-8404-46da-9a5d-7963316e9dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:51.963523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620709e8-8404-46da-9a5d-7963316e9dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:51.963805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620709e8-8404-46da-9a5d-7963316e9dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:51.975304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620709e8-8404-46da-9a5d-7963316e9dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:51.977111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620709e8-8404-46da-9a5d-7963316e9dd2 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:51.987024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 732/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:54.353762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7fd7-a081-4aa2-b706-86ebde52a706 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:54.354269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7fd7-a081-4aa2-b706-86ebde52a706 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:54.354269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c7fd7-a081-4aa2-b706-86ebde52a706 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:54.355598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:54.361062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fef3a-b2fb-4288-b113-95e390fce56a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:54.361473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fef3a-b2fb-4288-b113-95e390fce56a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:54.361636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fef3a-b2fb-4288-b113-95e390fce56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:54.368268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=70 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:54.381104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5c5fef3a-b2fb-4288-b113-95e390fce56a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:54.382303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5c5fef3a-b2fb-4288-b113-95e390fce56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:54.390157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:54.428036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c7fd7-a081-4aa2-b706-86ebde52a706 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:54.433451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=73 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:46:54.439041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c7fd7-a081-4aa2-b706-86ebde52a706 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:54.443491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313f31-686f-4faa-9805-c15b4faf6984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:54.444106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313f31-686f-4faa-9805-c15b4faf6984 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:54.447632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313f31-686f-4faa-9805-c15b4faf6984 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:54.447632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313f31-686f-4faa-9805-c15b4faf6984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:54.453607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313f31-686f-4faa-9805-c15b4faf6984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:54.455126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313f31-686f-4faa-9805-c15b4faf6984 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:54.464939 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 728/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:56.805197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b0db-e3c2-4222-999d-092150f32bbe None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:56.805734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b0db-e3c2-4222-999d-092150f32bbe None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:56.805734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6b0db-e3c2-4222-999d-092150f32bbe None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:56.807051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:46:56.812994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377afbc-2608-47e8-9cc7-4977d8a4bbc4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:56.817706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377afbc-2608-47e8-9cc7-4977d8a4bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:56.817706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377afbc-2608-47e8-9cc7-4977d8a4bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:56.833491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6377afbc-2608-47e8-9cc7-4977d8a4bbc4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:56.834748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6377afbc-2608-47e8-9cc7-4977d8a4bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:56.843023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:56.888202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b0db-e3c2-4222-999d-092150f32bbe None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:56.899985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6b0db-e3c2-4222-999d-092150f32bbe None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:56.903725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c2e62-0105-4755-a123-b8d55e09467d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:56.904451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c2e62-0105-4755-a123-b8d55e09467d service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:56.904744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c2e62-0105-4755-a123-b8d55e09467d service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:56.905030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c2e62-0105-4755-a123-b8d55e09467d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:56.915324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c2e62-0105-4755-a123-b8d55e09467d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:56.916854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487c2e62-0105-4755-a123-b8d55e09467d service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:56.926496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 735/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:46:59.208261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c47720-db2c-44b6-b612-79dc6455da0a None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.208892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c47720-db2c-44b6-b612-79dc6455da0a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.208892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c47720-db2c-44b6-b612-79dc6455da0a None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.210218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:46:59.215568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811e3c-0d19-4dc6-951b-b31e97c7f120 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.215978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811e3c-0d19-4dc6-951b-b31e97c7f120 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.216130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a811e3c-0d19-4dc6-951b-b31e97c7f120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.234696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7a811e3c-0d19-4dc6-951b-b31e97c7f120 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:46:59.235901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7a811e3c-0d19-4dc6-951b-b31e97c7f120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:46:59.244216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:46:59.280039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c47720-db2c-44b6-b612-79dc6455da0a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:46:59.292236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c47720-db2c-44b6-b612-79dc6455da0a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:46:59.296273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce891b-16e2-41ed-8a9d-89377f6f1c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:46:59.296932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce891b-16e2-41ed-8a9d-89377f6f1c45 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:46:59.297217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce891b-16e2-41ed-8a9d-89377f6f1c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:46:59.297493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce891b-16e2-41ed-8a9d-89377f6f1c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:46:59.306958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce891b-16e2-41ed-8a9d-89377f6f1c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:46:59.308456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce891b-16e2-41ed-8a9d-89377f6f1c45 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:46:59.318219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 731/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:01.597641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1935b-b0c3-4f5d-8951-12887f109513 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.598198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1935b-b0c3-4f5d-8951-12887f109513 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.598198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1935b-b0c3-4f5d-8951-12887f109513 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.599593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:01.604964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09bc0b-0d13-437f-9dca-5b8e9029ce24 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.605375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09bc0b-0d13-437f-9dca-5b8e9029ce24 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.605531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09bc0b-0d13-437f-9dca-5b8e9029ce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.623786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ab09bc0b-0d13-437f-9dca-5b8e9029ce24 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:01.625064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ab09bc0b-0d13-437f-9dca-5b8e9029ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:01.633964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:01.671256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1935b-b0c3-4f5d-8951-12887f109513 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:01.682204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1935b-b0c3-4f5d-8951-12887f109513 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:01.685751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f388d6-9551-47dc-acb9-1021220988c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:01.686380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f388d6-9551-47dc-acb9-1021220988c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:01.686685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f388d6-9551-47dc-acb9-1021220988c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:01.686971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f388d6-9551-47dc-acb9-1021220988c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:01.696323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f388d6-9551-47dc-acb9-1021220988c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:01.697772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f388d6-9551-47dc-acb9-1021220988c3 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:01.707822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 738/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:11.617938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=17 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:11.702880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=17 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:33.879698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb933-8f4e-45d5-a657-7b9d76777963 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:33.880273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb933-8f4e-45d5-a657-7b9d76777963 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:33.880273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fb933-8f4e-45d5-a657-7b9d76777963 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:33.881564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 733/1471] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:33.886775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea3a23-4566-4425-ab0a-bddf4662b206 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:33.887183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea3a23-4566-4425-ab0a-bddf4662b206 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:33.887333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea3a23-4566-4425-ab0a-bddf4662b206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:33.904731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-72ea3a23-4566-4425-ab0a-bddf4662b206 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:33.905917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-72ea3a23-4566-4425-ab0a-bddf4662b206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:33.914122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 739/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:33.960729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df83dd4-3a5b-41e1-9c4b-b3fca6890092 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:33.961025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df83dd4-3a5b-41e1-9c4b-b3fca6890092 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:33.961308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df83dd4-3a5b-41e1-9c4b-b3fca6890092 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:33.962652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 734/1473] 10.222.0.33 () {54 vars in 962 bytes} [Thu Jun 2 13:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:33.967317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dd2e2-460a-4aaa-874c-6001f9fa4256 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:33.967610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dd2e2-460a-4aaa-874c-6001f9fa4256 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:33.967890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dd2e2-460a-4aaa-874c-6001f9fa4256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:33.985935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-124dd2e2-460a-4aaa-874c-6001f9fa4256 None None] MFA Rules not processed for user `de8dfe694ffb4716a09db9e1e6d9a9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:33.987798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-124dd2e2-460a-4aaa-874c-6001f9fa4256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:33.994175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 740/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Thu Jun 2 13:47:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:34.001176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df83dd4-3a5b-41e1-9c4b-b3fca6890092 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:34.011736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df83dd4-3a5b-41e1-9c4b-b3fca6890092 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:34.015282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16443a41-c1a6-4abf-bd0a-7d9bf7520daf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:34.015903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16443a41-c1a6-4abf-bd0a-7d9bf7520daf service glance] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:34.016189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16443a41-c1a6-4abf-bd0a-7d9bf7520daf service glance] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:34.016503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16443a41-c1a6-4abf-bd0a-7d9bf7520daf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:34.025495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16443a41-c1a6-4abf-bd0a-7d9bf7520daf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:34.026924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16443a41-c1a6-4abf-bd0a-7d9bf7520daf service glance] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:34.036976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 735/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:47:36.413722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661f2a-2cbd-4618-a264-74a12daaea27 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:36.414312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661f2a-2cbd-4618-a264-74a12daaea27 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:36.414312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b661f2a-2cbd-4618-a264-74a12daaea27 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:36.415660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 741/1476] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:36.420977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31aa6-e8c8-42ac-a9b9-8077ac132971 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:36.421391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31aa6-e8c8-42ac-a9b9-8077ac132971 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:36.421542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db31aa6-e8c8-42ac-a9b9-8077ac132971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:36.440533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4db31aa6-e8c8-42ac-a9b9-8077ac132971 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:36.442619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4db31aa6-e8c8-42ac-a9b9-8077ac132971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:36.450396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 736/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:36.474359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b661f2a-2cbd-4618-a264-74a12daaea27 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:36.487446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b661f2a-2cbd-4618-a264-74a12daaea27 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:36.492095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05151e3-2083-42bf-9442-4989028feda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:36.492813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05151e3-2083-42bf-9442-4989028feda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:36.493101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05151e3-2083-42bf-9442-4989028feda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:36.493384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05151e3-2083-42bf-9442-4989028feda9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:36.494120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05151e3-2083-42bf-9442-4989028feda9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:36.495917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-d05151e3-2083-42bf-9442-4989028feda9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:47:36.495917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:47:36.495917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:47:36.497113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05151e3-2083-42bf-9442-4989028feda9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:36.517292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 742/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Thu Jun 2 13:47:36 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:47:38.770109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb345-6319-41d2-acd0-cae9e53a9135 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.770639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb345-6319-41d2-acd0-cae9e53a9135 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.770639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eb345-6319-41d2-acd0-cae9e53a9135 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.771954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 737/1479] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:38.777153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3308b9-1cd7-4e4b-a503-7bafd71f31fe None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.777601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3308b9-1cd7-4e4b-a503-7bafd71f31fe None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.777705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3308b9-1cd7-4e4b-a503-7bafd71f31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.796049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-8d3308b9-1cd7-4e4b-a503-7bafd71f31fe None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:38.797282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8d3308b9-1cd7-4e4b-a503-7bafd71f31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:38.805581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 743/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:38.849507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eb345-6319-41d2-acd0-cae9e53a9135 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:38.864051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eb345-6319-41d2-acd0-cae9e53a9135 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:38.870058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0cfa0-133f-4bc4-b2dd-0a6dd1ab41b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:38.870782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0cfa0-133f-4bc4-b2dd-0a6dd1ab41b9 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:38.871139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0cfa0-133f-4bc4-b2dd-0a6dd1ab41b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:38.871576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0cfa0-133f-4bc4-b2dd-0a6dd1ab41b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:38.882706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0cfa0-133f-4bc4-b2dd-0a6dd1ab41b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:38.884383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0cfa0-133f-4bc4-b2dd-0a6dd1ab41b9 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:38.895605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 738/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:41.377316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e3c52-ad87-4673-ba37-74fdae6473f8 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:41.377887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e3c52-ad87-4673-ba37-74fdae6473f8 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:41.377887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e3c52-ad87-4673-ba37-74fdae6473f8 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:41.379255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 744/1482] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:41.384497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda2c-af92-4e62-b80a-79bfec77a0ec None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:41.384932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda2c-af92-4e62-b80a-79bfec77a0ec None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:41.385053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda2c-af92-4e62-b80a-79bfec77a0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:41.402455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-25afda2c-af92-4e62-b80a-79bfec77a0ec None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:41.403649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-25afda2c-af92-4e62-b80a-79bfec77a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:41.412842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 739/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:47:41.450092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e3c52-ad87-4673-ba37-74fdae6473f8 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:41.460865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906e3c52-ad87-4673-ba37-74fdae6473f8 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:41.464292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc6d97a-6546-441e-92f0-e39b39f49f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:41.464949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6d97a-6546-441e-92f0-e39b39f49f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:41.465233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6d97a-6546-441e-92f0-e39b39f49f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:41.465513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc6d97a-6546-441e-92f0-e39b39f49f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:41.474897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6d97a-6546-441e-92f0-e39b39f49f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:41.476315 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc6d97a-6546-441e-92f0-e39b39f49f1c service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:41.485489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 745/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:43.811040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150f7b-6d1e-4f4f-b468-6dfb4ec062c4 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:43.811564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150f7b-6d1e-4f4f-b468-6dfb4ec062c4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:43.811564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40150f7b-6d1e-4f4f-b468-6dfb4ec062c4 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:43.812903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 740/1485] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:43.818354 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec2c4-0aa6-4769-a931-3d51b1354f6f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:43.818766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec2c4-0aa6-4769-a931-3d51b1354f6f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:43.818931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ec2c4-0aa6-4769-a931-3d51b1354f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:43.838727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-008ec2c4-0aa6-4769-a931-3d51b1354f6f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:43.839951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-008ec2c4-0aa6-4769-a931-3d51b1354f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:43.848453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 746/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:43.885521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150f7b-6d1e-4f4f-b468-6dfb4ec062c4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:43.896781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40150f7b-6d1e-4f4f-b468-6dfb4ec062c4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:43.900279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2e75e-4b19-47c5-b7a2-bfe2ca2640c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:43.900947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2e75e-4b19-47c5-b7a2-bfe2ca2640c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:43.901235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2e75e-4b19-47c5-b7a2-bfe2ca2640c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:43.901513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2e75e-4b19-47c5-b7a2-bfe2ca2640c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:43.911159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2e75e-4b19-47c5-b7a2-bfe2ca2640c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:43.912624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2e75e-4b19-47c5-b7a2-bfe2ca2640c7 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:43.921879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 741/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:46.343358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cd032-62a9-4af6-a78b-2b071537a62d None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:46.343962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cd032-62a9-4af6-a78b-2b071537a62d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:46.343962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cd032-62a9-4af6-a78b-2b071537a62d None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:46.345384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 747/1488] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:46.350581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54edf-9275-491a-a7cb-d1576686d6e8 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:46.351031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54edf-9275-491a-a7cb-d1576686d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:46.351163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db54edf-9275-491a-a7cb-d1576686d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:46.368946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7db54edf-9275-491a-a7cb-d1576686d6e8 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:46.370140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7db54edf-9275-491a-a7cb-d1576686d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:46.378379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 742/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:46.418402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cd032-62a9-4af6-a78b-2b071537a62d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:46.429155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cd032-62a9-4af6-a78b-2b071537a62d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:46.432740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f135c4-f519-40c9-a515-c5061871f99e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:46.433373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f135c4-f519-40c9-a515-c5061871f99e service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:46.433664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f135c4-f519-40c9-a515-c5061871f99e service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:46.433947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f135c4-f519-40c9-a515-c5061871f99e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:46.443514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f135c4-f519-40c9-a515-c5061871f99e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:46.444979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f135c4-f519-40c9-a515-c5061871f99e service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:46.454344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 748/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:49.210228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab4e5-779a-4290-99c0-39d6ad1b5d95 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:49.210802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab4e5-779a-4290-99c0-39d6ad1b5d95 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:49.210802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab4e5-779a-4290-99c0-39d6ad1b5d95 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:49.212146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 743/1491] 10.222.0.33 () {54 vars in 926 bytes} [Thu Jun 2 13:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:47:49.217346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7797-7cda-4f53-b46a-c7aab0cd3dcb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:49.217792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7797-7cda-4f53-b46a-c7aab0cd3dcb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:49.217898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a7797-7cda-4f53-b46a-c7aab0cd3dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:49.236876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e29a7797-7cda-4f53-b46a-c7aab0cd3dcb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:47:49.238068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e29a7797-7cda-4f53-b46a-c7aab0cd3dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:47:49.246214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 749/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Thu Jun 2 13:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:47:49.286189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab4e5-779a-4290-99c0-39d6ad1b5d95 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:47:49.296965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab4e5-779a-4290-99c0-39d6ad1b5d95 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:47:49.301750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377c70c-f8f0-442d-880f-88dcbc4eb4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:47:49.302387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377c70c-f8f0-442d-880f-88dcbc4eb4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:47:49.302674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377c70c-f8f0-442d-880f-88dcbc4eb4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:47:49.302955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377c70c-f8f0-442d-880f-88dcbc4eb4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:47:49.315917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377c70c-f8f0-442d-880f-88dcbc4eb4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:47:49.317392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377c70c-f8f0-442d-880f-88dcbc4eb4e2 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:47:49.326712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 744/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:47:59.231336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=33 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:47:59.322507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=33 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:00.164451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506bf4e-5f9e-47c6-9fa0-b0bce0068154 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.165059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506bf4e-5f9e-47c6-9fa0-b0bce0068154 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.165059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506bf4e-5f9e-47c6-9fa0-b0bce0068154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.183886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-2506bf4e-5f9e-47c6-9fa0-b0bce0068154 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:00.185383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2506bf4e-5f9e-47c6-9fa0-b0bce0068154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:00.193268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 750/1494] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:00.201649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bfa5-c018-4f8d-a2df-5213e989264b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.202168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bfa5-c018-4f8d-a2df-5213e989264b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.202265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81bfa5-c018-4f8d-a2df-5213e989264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.220082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ec81bfa5-c018-4f8d-a2df-5213e989264b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:00.221287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ec81bfa5-c018-4f8d-a2df-5213e989264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:00.228910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 745/1495] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:00.234557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506bf4e-5f9e-47c6-9fa0-b0bce0068154 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.244254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506bf4e-5f9e-47c6-9fa0-b0bce0068154 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:00.249265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:00.249919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.250206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.250487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.251237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:50:00.251547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:00.252601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:00.252601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:50:00.252601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:50:00.253489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:00.265739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 751/1496] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:50:00.273839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81bfa5-c018-4f8d-a2df-5213e989264b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.284235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81bfa5-c018-4f8d-a2df-5213e989264b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:00.288831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:00.289490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.289776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.290054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.290767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:00.292558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING py.warnings [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:00.292558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: warnings.warn(msg) Jun 02 13:50:00.292558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: Jun 02 13:50:00.294575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:00.425806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 746/1497] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:50:00 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:50:00.429760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.439893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098ff1a-3a93-410f-abf7-56658c9bd48f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:00.495778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:00.496508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.496799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.497079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.497787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:00.498798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:00.498798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:50:00.498798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:50:00.500041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:00.569966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 752/1498] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:50:00 2022] POST /identity/v3/users => generated 290 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:50:00.574243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.585209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96ad1e-cf9e-46f6-b07e-9c2e091786c0 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:00.589759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:00.590965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.591249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.591527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.592251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:00.593595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING py.warnings [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:00.593595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: warnings.warn(msg) Jun 02 13:50:00.593595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: Jun 02 13:50:00.594495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:00.608860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 747/1499] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:50:00.613034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.622951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dadc1-97d8-40bb-b241-6a746c5fe95e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:00.627436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4635553-5524-4624-ac9c-ea1fdb11b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:00.628088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4635553-5524-4624-ac9c-ea1fdb11b24a admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.628376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4635553-5524-4624-ac9c-ea1fdb11b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.628685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4635553-5524-4624-ac9c-ea1fdb11b24a admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.629545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4635553-5524-4624-ac9c-ea1fdb11b24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:00.630588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-e4635553-5524-4624-ac9c-ea1fdb11b24a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:00.630588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:50:00.630588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:50:00.631453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4635553-5524-4624-ac9c-ea1fdb11b24a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:00.645321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 753/1500] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:50:00.649582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.660175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a001c69c-7a70-40d7-9340-86d69e2f9eb7 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:00.666300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ad030-a7a4-4f7e-89ad-cb3287c28461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:00.667189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ad030-a7a4-4f7e-89ad-cb3287c28461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.667473 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ad030-a7a4-4f7e-89ad-cb3287c28461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.667750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ad030-a7a4-4f7e-89ad-cb3287c28461 admin admin] PATH_INFO: `/v3/projects/092b80b43db04e84a4f9d84b29964770/users/434335f5a40e473e8650d2cb527b89ce/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.686147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ad030-a7a4-4f7e-89ad-cb3287c28461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=092b80b43db04e84a4f9d84b29964770, user_id=434335f5a40e473e8650d2cb527b89ce, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:00.689020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING py.warnings [None req-b68ad030-a7a4-4f7e-89ad-cb3287c28461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:00.689020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: warnings.warn(msg) Jun 02 13:50:00.689020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: Jun 02 13:50:00.691024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ad030-a7a4-4f7e-89ad-cb3287c28461 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:00.772418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 748/1501] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:50:00 2022] PUT /identity/v3/projects/092b80b43db04e84a4f9d84b29964770/users/434335f5a40e473e8650d2cb527b89ce/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:50:00.784803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04b2ef-9167-40a8-acf2-99f482c2ec3e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.785103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04b2ef-9167-40a8-acf2-99f482c2ec3e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.785392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04b2ef-9167-40a8-acf2-99f482c2ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.811977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1b04b2ef-9167-40a8-acf2-99f482c2ec3e None None] MFA Rules not processed for user `434335f5a40e473e8650d2cb527b89ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:00.813251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1b04b2ef-9167-40a8-acf2-99f482c2ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:00.891385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 754/1502] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:00.904679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aa854-7ebc-4eb2-a542-fe601ab85b2d None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.904978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aa854-7ebc-4eb2-a542-fe601ab85b2d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.905253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aa854-7ebc-4eb2-a542-fe601ab85b2d None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.906604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 749/1503] 10.222.0.33 () {54 vars in 963 bytes} [Thu Jun 2 13:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:50:00.911386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6db76-3957-4f5e-b04f-654afd8dd78e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:00.911680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6db76-3957-4f5e-b04f-654afd8dd78e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:00.911961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6db76-3957-4f5e-b04f-654afd8dd78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:00.929614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-97f6db76-3957-4f5e-b04f-654afd8dd78e None None] MFA Rules not processed for user `b20a4dea241b4c299fb947b946464ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:00.930815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-97f6db76-3957-4f5e-b04f-654afd8dd78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:00.973542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:00.980722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 755/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Thu Jun 2 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:50:00.988674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aa854-7ebc-4eb2-a542-fe601ab85b2d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:00.999770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aa854-7ebc-4eb2-a542-fe601ab85b2d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:01.003293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:01.003918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:01.004199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:01.004506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:01.013353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:01.014805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:01.023807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 750/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:50:01.065868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ee5d5-d44b-47b6-8a78-87b1d0657848 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:01.066164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ee5d5-d44b-47b6-8a78-87b1d0657848 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:01.066479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ee5d5-d44b-47b6-8a78-87b1d0657848 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:01.067765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 756/1506] 10.222.0.33 () {52 vars in 829 bytes} [Thu Jun 2 13:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:50:01.071489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:01.134489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa3c67-9724-49db-b4db-6c4aaca134fe service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:01.139948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:01.140848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:01.141137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:01.141418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] PATH_INFO: `/v3/users/434335f5a40e473e8650d2cb527b89ce` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:01.142611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] RBAC: Authorizing `identity:delete_user(user_id=434335f5a40e473e8650d2cb527b89ce)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:01.143643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING py.warnings [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:01.143643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: warnings.warn(msg) Jun 02 13:50:01.143643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: Jun 02 13:50:01.144891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:01.342910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434335f5a40e473e8650d2cb527b89ce'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:01.435606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434335f5a40e473e8650d2cb527b89ce'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:01.454579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434335f5a40e473e8650d2cb527b89ce'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:01.462636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:01.469367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434335f5a40e473e8650d2cb527b89ce'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:01.470050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434335f5a40e473e8650d2cb527b89ce'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:01.476006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 751/1507] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:50:01 2022] DELETE /identity/v3/users/434335f5a40e473e8650d2cb527b89ce => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:50:01.480448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:01.481448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:01.481545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:01.499485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:50:01.500708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:01.557872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 757/1508] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:50:01.630831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:01.630831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:01.630831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c883b2b-8d04-49e6-aef8-191882aa946c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:01.634556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53827897-a921-4057-a2eb-ddb788346bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:01.635263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827897-a921-4057-a2eb-ddb788346bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:01.635549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827897-a921-4057-a2eb-ddb788346bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:01.635824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53827897-a921-4057-a2eb-ddb788346bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:01.645042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53827897-a921-4057-a2eb-ddb788346bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:01.646511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53827897-a921-4057-a2eb-ddb788346bb3 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:01.655794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 752/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:50:02.125697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:50:02.127365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:50:02.140562 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeeb37-7acc-4231-ae4e-af385dedffa4 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:50:02.147058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:50:02.147943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:50:02.148340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:50:02.148655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] PATH_INFO: `/v3/projects/092b80b43db04e84a4f9d84b29964770` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:50:02.149864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=092b80b43db04e84a4f9d84b29964770)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:50:02.152111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:50:02.152111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:50:02.152111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:50:02.153642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:50:02.304538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092b80b43db04e84a4f9d84b29964770', 'request_id': 'req-8dffa920-92bc-4279-ab4e-7fae185fa0d7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:02.318620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092b80b43db04e84a4f9d84b29964770', 'request_id': 'req-8dffa920-92bc-4279-ab4e-7fae185fa0d7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:02.383938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092b80b43db04e84a4f9d84b29964770', 'request_id': 'req-8dffa920-92bc-4279-ab4e-7fae185fa0d7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:02.395361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] The token cache is being invalidate because project 092b80b43db04e84a4f9d84b29964770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:50:02.395602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:02.396619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8dffa920-92bc-4279-ab4e-7fae185fa0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:50:02.398192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 758/1510] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:50:02 2022] DELETE /identity/v3/projects/092b80b43db04e84a4f9d84b29964770 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:50:11.651618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=29 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:50:12.392179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:51:43.420848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe0067-cbf1-4ff2-a1ae-081f6503c3e9 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:43.421482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe0067-cbf1-4ff2-a1ae-081f6503c3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:43.421482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe0067-cbf1-4ff2-a1ae-081f6503c3e9 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:43.422782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:51:43.427579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a507676-7325-4708-b3ae-f97e9d7a9fc3 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:43.428078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a507676-7325-4708-b3ae-f97e9d7a9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:43.428182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a507676-7325-4708-b3ae-f97e9d7a9fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:43.446177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6a507676-7325-4708-b3ae-f97e9d7a9fc3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:43.448356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6a507676-7325-4708-b3ae-f97e9d7a9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:43.522831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:43.693735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe0067-cbf1-4ff2-a1ae-081f6503c3e9 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:43.695762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8cfe0067-cbf1-4ff2-a1ae-081f6503c3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:43.769528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe0067-cbf1-4ff2-a1ae-081f6503c3e9 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:43.775628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d5dd4-1d84-460a-bc9d-dbfdde8279d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:43.776269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5dd4-1d84-460a-bc9d-dbfdde8279d2 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:43.776595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5dd4-1d84-460a-bc9d-dbfdde8279d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:43.776883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d5dd4-1d84-460a-bc9d-dbfdde8279d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:43.786127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d5dd4-1d84-460a-bc9d-dbfdde8279d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:43.787768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d5dd4-1d84-460a-bc9d-dbfdde8279d2 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:43.798267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 754/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:44.675295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f09e63-5083-4061-a790-d9e8da9006fa None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:44.675891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f09e63-5083-4061-a790-d9e8da9006fa None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:44.675891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f09e63-5083-4061-a790-d9e8da9006fa None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:44.677254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:51:44.682683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925455b-6d40-40be-b76a-5129ba96fafe None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:44.683114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925455b-6d40-40be-b76a-5129ba96fafe None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:44.683234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925455b-6d40-40be-b76a-5129ba96fafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:44.702282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0925455b-6d40-40be-b76a-5129ba96fafe None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:44.703565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0925455b-6d40-40be-b76a-5129ba96fafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:44.711681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:44.772081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8921981-c338-4a61-9bb1-7d2f1d03f0d0 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:44.772307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8921981-c338-4a61-9bb1-7d2f1d03f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:44.772623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8921981-c338-4a61-9bb1-7d2f1d03f0d0 None None] PATH_INFO: `/v3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:44.773951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 761/1516] 10.222.0.64 () {54 vars in 925 bytes} [Thu Jun 2 13:51:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:51:44.786578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ee728-e4d4-40e4-96b3-ac23ac51a80b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:44.786872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ee728-e4d4-40e4-96b3-ac23ac51a80b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:44.787157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ee728-e4d4-40e4-96b3-ac23ac51a80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:44.808759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4f3ee728-e4d4-40e4-96b3-ac23ac51a80b None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:44.809976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4f3ee728-e4d4-40e4-96b3-ac23ac51a80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:44.873439 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8921981-c338-4a61-9bb1-7d2f1d03f0d0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:44.873745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 756/1517] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jun 2 13:51:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:44.889558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8921981-c338-4a61-9bb1-7d2f1d03f0d0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:44.894906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6cfc6-1601-485f-9813-5fcb3afa11f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:44.895678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6cfc6-1601-485f-9813-5fcb3afa11f7 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:44.895967 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6cfc6-1601-485f-9813-5fcb3afa11f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:44.896247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6cfc6-1601-485f-9813-5fcb3afa11f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:44.905014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6cfc6-1601-485f-9813-5fcb3afa11f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:44.906584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6cfc6-1601-485f-9813-5fcb3afa11f7 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:44.916835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 762/1518] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:54.592648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33cd8a-6272-4998-b748-da9f27ddde3c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:54.593221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33cd8a-6272-4998-b748-da9f27ddde3c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:54.593221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33cd8a-6272-4998-b748-da9f27ddde3c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:54.594580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 757/1519] 10.222.0.33 () {54 vars in 960 bytes} [Thu Jun 2 13:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:51:54.599698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fffff1-bab1-4795-99b2-c8ed5c3e441c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:54.600136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fffff1-bab1-4795-99b2-c8ed5c3e441c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:54.600289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fffff1-bab1-4795-99b2-c8ed5c3e441c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:54.618143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d4fffff1-bab1-4795-99b2-c8ed5c3e441c None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:54.619917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d4fffff1-bab1-4795-99b2-c8ed5c3e441c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:54.628453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 763/1520] 10.222.0.33 () {58 vars in 1057 bytes} [Thu Jun 2 13:51:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:54.636734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33cd8a-6272-4998-b748-da9f27ddde3c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:54.649763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33cd8a-6272-4998-b748-da9f27ddde3c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:54.654731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78193b4a-d988-42f7-a930-7369e928003c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:54.655354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78193b4a-d988-42f7-a930-7369e928003c service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:54.655637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78193b4a-d988-42f7-a930-7369e928003c service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:54.655916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78193b4a-d988-42f7-a930-7369e928003c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:54.663994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78193b4a-d988-42f7-a930-7369e928003c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:54.665617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78193b4a-d988-42f7-a930-7369e928003c service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:54.675535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 758/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:56.207688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ca80-4280-4757-86e1-8e4e1a39067e None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:56.208238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ca80-4280-4757-86e1-8e4e1a39067e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:56.208238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ca80-4280-4757-86e1-8e4e1a39067e None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:56.209645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:51:56.215192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931855b6-deb3-47ec-ad7f-32afab09bc84 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:56.215638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931855b6-deb3-47ec-ad7f-32afab09bc84 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:56.215846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931855b6-deb3-47ec-ad7f-32afab09bc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:56.233958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-931855b6-deb3-47ec-ad7f-32afab09bc84 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:56.235171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-931855b6-deb3-47ec-ad7f-32afab09bc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:56.243176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:56.394901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ca80-4280-4757-86e1-8e4e1a39067e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:56.410899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359ca80-4280-4757-86e1-8e4e1a39067e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:56.416788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac043b2f-4bf2-4812-9ef2-6fdef74e11d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:56.417426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043b2f-4bf2-4812-9ef2-6fdef74e11d0 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:56.417714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043b2f-4bf2-4812-9ef2-6fdef74e11d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:56.417994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac043b2f-4bf2-4812-9ef2-6fdef74e11d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:56.426071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043b2f-4bf2-4812-9ef2-6fdef74e11d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:56.427647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac043b2f-4bf2-4812-9ef2-6fdef74e11d0 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:56.437525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 765/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:51:57.305899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a233-c32a-45d7-8d2f-99e784209027 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:57.306430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a233-c32a-45d7-8d2f-99e784209027 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:57.306430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6a233-c32a-45d7-8d2f-99e784209027 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:57.308248 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 2 13:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:51:57.313213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a38d3f-6001-4f9d-a6af-399015bda6df None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:57.313642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a38d3f-6001-4f9d-a6af-399015bda6df None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:57.313813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a38d3f-6001-4f9d-a6af-399015bda6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:57.332612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c9a38d3f-6001-4f9d-a6af-399015bda6df None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:51:57.333810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c9a38d3f-6001-4f9d-a6af-399015bda6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:51:57.341728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 2 13:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:51:57.499613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6a233-c32a-45d7-8d2f-99e784209027 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:51:57.514702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6a233-c32a-45d7-8d2f-99e784209027 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:51:57.520166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df70fa3-1e9a-4c46-871f-e8f2fa241874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:51:57.520833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df70fa3-1e9a-4c46-871f-e8f2fa241874 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:51:57.521121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df70fa3-1e9a-4c46-871f-e8f2fa241874 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:51:57.521400 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df70fa3-1e9a-4c46-871f-e8f2fa241874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:51:57.529771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df70fa3-1e9a-4c46-871f-e8f2fa241874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:51:57.531373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df70fa3-1e9a-4c46-871f-e8f2fa241874 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:51:57.540941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 761/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:02.083570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd5a28-08b9-42c6-aaab-b83cfc63a28f None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:02.084087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd5a28-08b9-42c6-aaab-b83cfc63a28f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:02.084087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd5a28-08b9-42c6-aaab-b83cfc63a28f None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:02.085442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:52:02.090816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a92b-b557-4b8a-9143-a09488d8971a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:02.091263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a92b-b557-4b8a-9143-a09488d8971a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:02.091382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3558a92b-b557-4b8a-9143-a09488d8971a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:02.109690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3558a92b-b557-4b8a-9143-a09488d8971a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:02.110924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3558a92b-b557-4b8a-9143-a09488d8971a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:02.118961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:02.229495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd5a28-08b9-42c6-aaab-b83cfc63a28f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:02.231443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b2bd5a28-08b9-42c6-aaab-b83cfc63a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:02.288149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd5a28-08b9-42c6-aaab-b83cfc63a28f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:02.292450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61ff31-be81-448b-8012-4ef79866a2c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:02.293091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ff31-be81-448b-8012-4ef79866a2c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:02.293381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ff31-be81-448b-8012-4ef79866a2c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:02.293664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ff31-be81-448b-8012-4ef79866a2c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:02.302623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61ff31-be81-448b-8012-4ef79866a2c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:02.304061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61ff31-be81-448b-8012-4ef79866a2c6 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:02.314068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 768/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:04.620498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b480c6-c58d-441f-8063-7ac801ddfd6b None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:04.621055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b480c6-c58d-441f-8063-7ac801ddfd6b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:04.621055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b480c6-c58d-441f-8063-7ac801ddfd6b None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:04.622423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:52:04.627692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d262-de95-49c6-a134-1514c6acb936 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:04.628121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d262-de95-49c6-a134-1514c6acb936 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:04.628261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d262-de95-49c6-a134-1514c6acb936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:04.646912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e043d262-de95-49c6-a134-1514c6acb936 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:04.648109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e043d262-de95-49c6-a134-1514c6acb936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:04.656865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:52:04.691470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b480c6-c58d-441f-8063-7ac801ddfd6b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:04.702876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b480c6-c58d-441f-8063-7ac801ddfd6b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:04.706375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18ee83c-b6dc-40dc-a7fd-56b9fb974989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:04.706995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee83c-b6dc-40dc-a7fd-56b9fb974989 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:04.707280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee83c-b6dc-40dc-a7fd-56b9fb974989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:04.707560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ee83c-b6dc-40dc-a7fd-56b9fb974989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:04.717279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ee83c-b6dc-40dc-a7fd-56b9fb974989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:04.718730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18ee83c-b6dc-40dc-a7fd-56b9fb974989 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:04.728342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 764/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:08.590882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525185-8e33-4d76-bfa2-9ff5503e2d2a None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:08.591444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525185-8e33-4d76-bfa2-9ff5503e2d2a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:08.591444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e525185-8e33-4d76-bfa2-9ff5503e2d2a None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:08.592858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:52:08.598142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd205a4-568f-4bca-a314-1f1aee78dbd3 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:08.600187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd205a4-568f-4bca-a314-1f1aee78dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:08.600187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd205a4-568f-4bca-a314-1f1aee78dbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:08.617216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3bd205a4-568f-4bca-a314-1f1aee78dbd3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:08.618474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3bd205a4-568f-4bca-a314-1f1aee78dbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:08.626665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:08.911083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e525185-8e33-4d76-bfa2-9ff5503e2d2a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:08.912795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6e525185-8e33-4d76-bfa2-9ff5503e2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:08.970207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e525185-8e33-4d76-bfa2-9ff5503e2d2a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:08.973820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed38f599-0f78-408a-9fd2-8ae6d8e056e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:08.974466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38f599-0f78-408a-9fd2-8ae6d8e056e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:08.974759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38f599-0f78-408a-9fd2-8ae6d8e056e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:08.975232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed38f599-0f78-408a-9fd2-8ae6d8e056e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:08.984714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38f599-0f78-408a-9fd2-8ae6d8e056e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:08.986154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed38f599-0f78-408a-9fd2-8ae6d8e056e5 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:08.991129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:08.996031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 771/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:52:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:11.265695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60981ac5-0cdc-4b6b-ba52-0a674bfb79c1 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:11.266263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60981ac5-0cdc-4b6b-ba52-0a674bfb79c1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:11.266263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60981ac5-0cdc-4b6b-ba52-0a674bfb79c1 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:11.267673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 2 13:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:52:11.272865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940945-2490-4b7c-bd28-c1313ddd12bb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:11.273321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940945-2490-4b7c-bd28-c1313ddd12bb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:11.273467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940945-2490-4b7c-bd28-c1313ddd12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:11.292199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-39940945-2490-4b7c-bd28-c1313ddd12bb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:52:11.293490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-39940945-2490-4b7c-bd28-c1313ddd12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:11.301242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 2 13:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:52:11.576848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60981ac5-0cdc-4b6b-ba52-0a674bfb79c1 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:52:11.578596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-60981ac5-0cdc-4b6b-ba52-0a674bfb79c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:52:11.592256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60981ac5-0cdc-4b6b-ba52-0a674bfb79c1 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:52:11.595846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d00a18-38e8-4ee3-acfc-0d0b5b4a0153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:52:11.596512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00a18-38e8-4ee3-acfc-0d0b5b4a0153 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:52:11.596799 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00a18-38e8-4ee3-acfc-0d0b5b4a0153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:52:11.597079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d00a18-38e8-4ee3-acfc-0d0b5b4a0153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:52:11.607290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d00a18-38e8-4ee3-acfc-0d0b5b4a0153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:52:11.608776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d00a18-38e8-4ee3-acfc-0d0b5b4a0153 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:52:11.617936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 767/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:52:21.286431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:52:21.613965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:49.612964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2e47-48d5-406b-a232-0ea352eee7b6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:49.613603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2e47-48d5-406b-a232-0ea352eee7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:49.613603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb2e47-48d5-406b-a232-0ea352eee7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:49.644823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-27bb2e47-48d5-406b-a232-0ea352eee7b6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:49.646123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-27bb2e47-48d5-406b-a232-0ea352eee7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:49.659487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 773/1540] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:49.668144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa2d4-46d3-43a9-8b7f-d2ecdd2c68bf None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:49.668748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa2d4-46d3-43a9-8b7f-d2ecdd2c68bf None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:49.668849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fa2d4-46d3-43a9-8b7f-d2ecdd2c68bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:49.689099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d72fa2d4-46d3-43a9-8b7f-d2ecdd2c68bf None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:49.690313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d72fa2d4-46d3-43a9-8b7f-d2ecdd2c68bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:49.703204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 768/1541] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:49.707764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2e47-48d5-406b-a232-0ea352eee7b6 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:49.718616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb2e47-48d5-406b-a232-0ea352eee7b6 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:49.728275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26334d-d147-47d3-b355-ac0e235b8fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:49.728988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26334d-d147-47d3-b355-ac0e235b8fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:49.729278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26334d-d147-47d3-b355-ac0e235b8fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:49.729558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26334d-d147-47d3-b355-ac0e235b8fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:49.730295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26334d-d147-47d3-b355-ac0e235b8fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:49.730609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26334d-d147-47d3-b355-ac0e235b8fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:49.732964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a26334d-d147-47d3-b355-ac0e235b8fa0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:49.746368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 774/1542] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:49.755104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fa2d4-46d3-43a9-8b7f-d2ecdd2c68bf None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:49.769715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fa2d4-46d3-43a9-8b7f-d2ecdd2c68bf None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:49.777729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:49.778407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:49.778696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:49.779565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:49.780324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:49.782284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:49.879392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbac45-181d-4354-b2d8-12c8007bf1cc None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:49.879743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbac45-181d-4354-b2d8-12c8007bf1cc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:49.879962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbac45-181d-4354-b2d8-12c8007bf1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:49.902264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 769/1543] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:49 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:49.907986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:49.908233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bfdbac45-181d-4354-b2d8-12c8007bf1cc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:49.909433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bfdbac45-181d-4354-b2d8-12c8007bf1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.021926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 775/1544] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:53:50.034659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79461dcd-744f-40b3-96d7-47229451546d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.035169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79461dcd-744f-40b3-96d7-47229451546d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.035786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79461dcd-744f-40b3-96d7-47229451546d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.069936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-79461dcd-744f-40b3-96d7-47229451546d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.071219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-79461dcd-744f-40b3-96d7-47229451546d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.072905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9129cfc-a695-41fc-ac59-4bc1c3e256d6 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.082690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 776/1545] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.084041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de28afb-516b-43f9-86b4-1d5d348bf593 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.084170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.084377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de28afb-516b-43f9-86b4-1d5d348bf593 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.084645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de28afb-516b-43f9-86b4-1d5d348bf593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.084825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.085102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.085377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.086165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.087383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING py.warnings [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:53:50.087383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: warnings.warn(msg) Jun 02 13:53:50.087383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: Jun 02 13:53:50.088670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.121544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-2de28afb-516b-43f9-86b4-1d5d348bf593 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.122928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2de28afb-516b-43f9-86b4-1d5d348bf593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.141607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 777/1546] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.143549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27803f-910b-4374-8e75-a9d7d3d497cd None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.143848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27803f-910b-4374-8e75-a9d7d3d497cd None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.144139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27803f-910b-4374-8e75-a9d7d3d497cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.172349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-8b27803f-910b-4374-8e75-a9d7d3d497cd None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.173612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8b27803f-910b-4374-8e75-a9d7d3d497cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.188089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 770/1547] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:49 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:53:50.190551 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 778/1548] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.192193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.195508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27803f-910b-4374-8e75-a9d7d3d497cd None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.206296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27803f-910b-4374-8e75-a9d7d3d497cd None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.210363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b703aa8-3dca-443e-a394-aefb2d9ff353 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.219221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.219601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.219893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.220286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.220595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.221330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:50.221637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.222082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.222635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.222757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING py.warnings [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:53:50.222757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: warnings.warn(msg) Jun 02 13:53:50.222757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: Jun 02 13:53:50.223635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.224017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.225045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.227223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.246896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 771/1549] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:50.248798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 779/1550] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:53:50.248937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.252810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.266352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54969a3c-3e83-4a5b-8955-15f2b006d67e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.266554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b358f47-2491-4877-9417-2ca8564cf333 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.277140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69b59c-23d8-4921-98dc-faba591cd12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.277830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69b59c-23d8-4921-98dc-faba591cd12a admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.278117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69b59c-23d8-4921-98dc-faba591cd12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.278390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69b59c-23d8-4921-98dc-faba591cd12a admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.279353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69b59c-23d8-4921-98dc-faba591cd12a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:50.279676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69b59c-23d8-4921-98dc-faba591cd12a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.281416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69b59c-23d8-4921-98dc-faba591cd12a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.282235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.282927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.283228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.283500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.284236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.285856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.297757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 780/1551] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:53:50.298631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.315673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 772/1552] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:50.316897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898151b6-f780-4f0f-b068-7c8bd692623f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.317204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898151b6-f780-4f0f-b068-7c8bd692623f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.317472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898151b6-f780-4f0f-b068-7c8bd692623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.327383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4320d9-b5b9-42fa-b694-efdb0875fb1b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.346282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-898151b6-f780-4f0f-b068-7c8bd692623f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.347518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-898151b6-f780-4f0f-b068-7c8bd692623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.349078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.349763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.350058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.350339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.351031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.352056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:53:50.352056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:53:50.352056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:53:50.353399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.365412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 773/1553] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.366307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898151b6-f780-4f0f-b068-7c8bd692623f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.383404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898151b6-f780-4f0f-b068-7c8bd692623f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.394748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c577b-61bb-401e-9240-93167a8172ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.411233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c577b-61bb-401e-9240-93167a8172ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.411233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c577b-61bb-401e-9240-93167a8172ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.411233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c577b-61bb-401e-9240-93167a8172ff admin admin] PATH_INFO: `/v3/projects/56c3f04e3f164a77b32b1e320d979863/users/4dd10f5fa400450fb64360391a871bb8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.419314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c577b-61bb-401e-9240-93167a8172ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=56c3f04e3f164a77b32b1e320d979863, user_id=4dd10f5fa400450fb64360391a871bb8, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.422782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c577b-61bb-401e-9240-93167a8172ff admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.509426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 781/1554] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:50.510548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.539925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 774/1555] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:50 2022] PUT /identity/v3/projects/56c3f04e3f164a77b32b1e320d979863/users/4dd10f5fa400450fb64360391a871bb8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:50.539925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7188-9d11-4c3e-bc8b-da010fdb6b5d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.539925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7188-9d11-4c3e-bc8b-da010fdb6b5d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.539925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfc7188-9d11-4c3e-bc8b-da010fdb6b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.558633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-cbfc7188-9d11-4c3e-bc8b-da010fdb6b5d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.560060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-cbfc7188-9d11-4c3e-bc8b-da010fdb6b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.577834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f08d0-a2ea-4a04-a9be-4f5ddb329c3b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.597971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:50.618705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 775/1556] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.620089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014dd8-844e-40fe-8f0c-d6153ef46f52 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.620391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014dd8-844e-40fe-8f0c-d6153ef46f52 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.620702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1014dd8-844e-40fe-8f0c-d6153ef46f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.627878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:50.636414 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.637837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.638357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.639132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e1014dd8-844e-40fe-8f0c-d6153ef46f52 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.639274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.640061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.640336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e1014dd8-844e-40fe-8f0c-d6153ef46f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.642132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.648244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 776/1557] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.649496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bdf11-0fbb-4b99-b462-ec79e821b200 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.649787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bdf11-0fbb-4b99-b462-ec79e821b200 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.650068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bdf11-0fbb-4b99-b462-ec79e821b200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.668225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2f0bdf11-0fbb-4b99-b462-ec79e821b200 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.671776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2f0bdf11-0fbb-4b99-b462-ec79e821b200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.678266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 777/1558] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.679468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2f56e-c1a3-44f6-8c67-8d8af40576fc None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.679762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2f56e-c1a3-44f6-8c67-8d8af40576fc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.680044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2f56e-c1a3-44f6-8c67-8d8af40576fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.697840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e5b2f56e-c1a3-44f6-8c67-8d8af40576fc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.699409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e5b2f56e-c1a3-44f6-8c67-8d8af40576fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.707457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 778/1559] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.708763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546c28-596c-478d-8cda-a56eb3965ab2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.709058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546c28-596c-478d-8cda-a56eb3965ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.709342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46546c28-596c-478d-8cda-a56eb3965ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.727246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 782/1560] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/projects => generated 405 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:50.727246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.738856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-46546c28-596c-478d-8cda-a56eb3965ab2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.738856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-46546c28-596c-478d-8cda-a56eb3965ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.797304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 779/1561] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.798903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36563f71-0ed4-41c5-a3dc-0689fa2f666e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.799209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36563f71-0ed4-41c5-a3dc-0689fa2f666e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.800615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36563f71-0ed4-41c5-a3dc-0689fa2f666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.820164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8f76b-0405-4779-b1a7-810883ec3b4e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.820576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-36563f71-0ed4-41c5-a3dc-0689fa2f666e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.821813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-36563f71-0ed4-41c5-a3dc-0689fa2f666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.833079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.833079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.833079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.833079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.833682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.833682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.833921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 780/1562] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.833921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36563f71-0ed4-41c5-a3dc-0689fa2f666e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.853372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36563f71-0ed4-41c5-a3dc-0689fa2f666e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.859426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21940002-6c42-432f-a8c7-d75c27022544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.860092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21940002-6c42-432f-a8c7-d75c27022544 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.860384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21940002-6c42-432f-a8c7-d75c27022544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.860695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21940002-6c42-432f-a8c7-d75c27022544 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.861792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21940002-6c42-432f-a8c7-d75c27022544 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:50.862108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21940002-6c42-432f-a8c7-d75c27022544 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.863728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21940002-6c42-432f-a8c7-d75c27022544 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.875380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 781/1563] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:50.876675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c4a7-b1df-4ef7-a443-265bd6d40018 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.876972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c4a7-b1df-4ef7-a443-265bd6d40018 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.877254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c4a7-b1df-4ef7-a443-265bd6d40018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.895142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b8b7c4a7-b1df-4ef7-a443-265bd6d40018 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.896384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b8b7c4a7-b1df-4ef7-a443-265bd6d40018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.904773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 782/1564] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.906076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989023f6-b042-4262-b85f-05f3515a930e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.906367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989023f6-b042-4262-b85f-05f3515a930e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.906644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989023f6-b042-4262-b85f-05f3515a930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.924242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-989023f6-b042-4262-b85f-05f3515a930e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.925474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-989023f6-b042-4262-b85f-05f3515a930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.933460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 783/1565] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.934744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c62b0-d1c5-4eb0-bdc5-d108bd1415b5 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.935086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c62b0-d1c5-4eb0-bdc5-d108bd1415b5 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.935377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c62b0-d1c5-4eb0-bdc5-d108bd1415b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.937413 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 783/1566] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:50.937413 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:50.949393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c84e35-1ba9-4e5a-9108-d57c24c9dd78 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:50.954719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:50.955386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.955676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.955957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.956230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-184c62b0-d1c5-4eb0-bdc5-d108bd1415b5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.956697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:50.957480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-184c62b0-d1c5-4eb0-bdc5-d108bd1415b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.958660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:50.965472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 784/1567] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.967708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09a2a-bd7a-44d0-b069-59e214def6fe None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:50.968008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09a2a-bd7a-44d0-b069-59e214def6fe None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:50.968295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09a2a-bd7a-44d0-b069-59e214def6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:50.986042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-67e09a2a-bd7a-44d0-b069-59e214def6fe None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:50.987234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-67e09a2a-bd7a-44d0-b069-59e214def6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:50.995854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 785/1568] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:50.996671 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e09a2a-bd7a-44d0-b069-59e214def6fe None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.051552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e09a2a-bd7a-44d0-b069-59e214def6fe None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.055136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.055811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.056095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.056375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.065957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.067504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.077710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 786/1569] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:51.078511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.087443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 784/1570] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:50 2022] POST /identity/v3/users => generated 303 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.087601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f9430-78fd-419f-8af8-9c64368dc8e8 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.088668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.093113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.094011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.094302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.094582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.095310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.097262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.100131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d25b7-ec00-40d5-94a2-a0b42b77e795 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.105252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.105911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.109542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.109542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.109542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:51.109542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.109542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.122032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 785/1571] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:51.123197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.133110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a31fd-4e17-4cf8-981a-23d2f5ab71cf admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.137827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.141776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.141776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.141776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.141776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:51.141776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.143963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.167544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 786/1572] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:51.168431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.178530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e0cba0-b045-4157-91ab-6a0431a283f3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.183219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.183864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.184146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.184449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.185853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.187451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.200271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 787/1573] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:51.201962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.212818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e37609-3eed-47be-877d-18423f3776a3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.217477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.218120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.218405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.218680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.219392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:51.219696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.221410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.232017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 787/1574] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.233685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.235974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 788/1575] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:51.237228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.253305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620ad01-61fe-4911-b0f9-f90a5b1c0dcf admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.267837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:51.287880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:51.310758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1e6ce-1429-4544-a73c-644f4bdc7962 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.315967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.316151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.316657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.316924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.317037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.317210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.317338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.317491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.317929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:53:51.318362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.318484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.319869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.320025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.331355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 789/1576] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:51.332379 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.336564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 788/1577] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:53:51.337803 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.343637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de557-ce94-4899-84e9-1883924fcaea admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.348792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea95a2b-7142-4f6a-a14c-b3aa7243aa63 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.353605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.357130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.357130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.357130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.357130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.357460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.357460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.357881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.357995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.358083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.358695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.360616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.447199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 789/1578] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.448148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.504732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 790/1579] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/projects => generated 367 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.507438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.521270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1cdc8b-d240-4a39-892e-c5bc3362e3bd admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.569736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad73b2-7e36-4810-8d0e-ecbd56dd6e08 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.574918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.575625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.576383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.576763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.577451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.578988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.579376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.579652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.579936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.580213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.580992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.582686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.594279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 790/1580] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:51.595101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.606710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295365e-7970-4a44-83fb-def206209ad0 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.611494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.612133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.612444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.612729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.613521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.615600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.686868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 791/1581] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.686868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.694231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add11c3-cc9e-4eb2-a61a-38fa85595862 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.698792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.699707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.699989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.700270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.701700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.703317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.713508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 792/1582] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:51.714303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.724231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f81825-ddcc-458f-8d2b-b150f8fe672c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.729107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.729762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.730052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.733489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.733489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.733779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.743616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 791/1583] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.744582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.760384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:51.808837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78da13-e3bc-4983-aca8-e21390663a32 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.814971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 793/1584] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.814971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:51.872823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.874823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.875042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.875354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.876058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.878286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.882751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89569d-a64c-4749-8fc3-81e5b4532dc7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:51.888549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:51.889363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:51.889762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:51.890105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:51.890823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:51.892844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:51.901059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:51.987244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 792/1585] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:51.987244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.006387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc00523-a5de-408a-87d8-8362571cec90 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.006809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 794/1586] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:51 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:52.007943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.015765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.018678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.019143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.019586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] PATH_INFO: `/v3/projects/b067e3c448e24f179830992fecf65399/users/f9e57606c14a4ad99612414c1f9719f4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.019953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a687a89a-df69-4fae-b428-f4e3cd4efed7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.025830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.026539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.026830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.027113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.027853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.030376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.038529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b067e3c448e24f179830992fecf65399, user_id=f9e57606c14a4ad99612414c1f9719f4, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.040698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 795/1587] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.041536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.045640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.052104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fbd26-c4fb-4666-9267-b7f74178b0f8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.056706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.057576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.057859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.059063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] PATH_INFO: `/v3/projects/c422d8ee8a2e4e369a569fb1599978e7/users/a43cd6021eca4bbbb6b07f4374e4b79b/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.074430 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c422d8ee8a2e4e369a569fb1599978e7, user_id=a43cd6021eca4bbbb6b07f4374e4b79b, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.075535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:53:52.075535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:53:52.075535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:53:52.077903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.124367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 793/1588] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:51 2022] PUT /identity/v3/projects/b067e3c448e24f179830992fecf65399/users/f9e57606c14a4ad99612414c1f9719f4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:52.129020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.194525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba693ba-49f1-4d63-a037-60358f667779 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.194633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 796/1589] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:52 2022] PUT /identity/v3/projects/c422d8ee8a2e4e369a569fb1599978e7/users/a43cd6021eca4bbbb6b07f4374e4b79b/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:52.195656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.228438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:52.255158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.255993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.256390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.256801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.257496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.259629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.265889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f1081-8dec-4943-a576-ad663bdf1988 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.270723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf4beb-0034-4f6c-99a1-c7e88c81bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.271389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf4beb-0034-4f6c-99a1-c7e88c81bf78 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.271677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf4beb-0034-4f6c-99a1-c7e88c81bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.272732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf4beb-0034-4f6c-99a1-c7e88c81bf78 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.272732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf4beb-0034-4f6c-99a1-c7e88c81bf78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.274694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf4beb-0034-4f6c-99a1-c7e88c81bf78 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.349040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 794/1590] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:52 2022] POST /identity/v3/users => generated 286 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:52.349874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.359026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5c25d-a34f-4fdb-b595-ed564ac78a38 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.363425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.364043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.364325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.364630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.365327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.366900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.376478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 795/1591] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.377230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.386081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbfe69-11bb-4e1e-8597-5837133ad74c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.391489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.392101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.392382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.392687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.393376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.394912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.408075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 796/1592] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.410448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.420638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b5185-2083-4730-9c66-30269591e3d6 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.425806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc4a5-020a-40fe-8882-ab2d41cfe293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.429707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 797/1593] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:52 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:52.429853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc4a5-020a-40fe-8882-ab2d41cfe293 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.429853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc4a5-020a-40fe-8882-ab2d41cfe293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.429853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc4a5-020a-40fe-8882-ab2d41cfe293 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.429853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cc4a5-020a-40fe-8882-ab2d41cfe293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.430149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007283b2-beb3-4a1c-922a-23a4cb078cf0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.430149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007283b2-beb3-4a1c-922a-23a4cb078cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.430149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007283b2-beb3-4a1c-922a-23a4cb078cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.430455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406cc4a5-020a-40fe-8882-ab2d41cfe293 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.441594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 797/1594] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.442710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a6bb-c193-4668-8a87-c953f3f16b11 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.443422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a6bb-c193-4668-8a87-c953f3f16b11 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.443422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15a6bb-c193-4668-8a87-c953f3f16b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.449226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-007283b2-beb3-4a1c-922a-23a4cb078cf0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:52.450457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-007283b2-beb3-4a1c-922a-23a4cb078cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:52.458721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 798/1595] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:52.459531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007283b2-beb3-4a1c-922a-23a4cb078cf0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.472895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007283b2-beb3-4a1c-922a-23a4cb078cf0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.477861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.478532 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.478827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.479109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.479845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.481515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.486618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5b15a6bb-c193-4668-8a87-c953f3f16b11 None None] MFA Rules not processed for user `a43cd6021eca4bbbb6b07f4374e4b79b`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:52.488716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5b15a6bb-c193-4668-8a87-c953f3f16b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:52.504267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 799/1596] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.505274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.519337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d3871-4016-41d5-89e3-58cb2283a66e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.524690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.525367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.527896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.527896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.527896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.528295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.540033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 800/1597] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.543899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.555657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f0b4a-57f3-49fe-8849-626e2a0d8736 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.560638 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.562100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.562395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.562777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.563653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.565304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.577446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 798/1598] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:52.577446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15a6bb-c193-4668-8a87-c953f3f16b11 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.582154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 801/1599] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.583073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.586780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15a6bb-c193-4668-8a87-c953f3f16b11 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.595042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.595720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.595949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe06f08-695c-4220-aa29-a97a201d5f2f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.596079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.596337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.597139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.598830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.601385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.602324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.602679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.603021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] PATH_INFO: `/v3/projects/91ff9725b24d4f4497fb30b5be5f5042/users/55e65624f420449d98bc45a04cba77f3/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.609886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 799/1600] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.610841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.630057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91ff9725b24d4f4497fb30b5be5f5042, user_id=55e65624f420449d98bc45a04cba77f3, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.633481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.676849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850a4d7-dd50-4106-a744-a7764dd55566 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.680547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.681284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.681585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.681965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.691978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.693474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.704528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 800/1601] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:52.705278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.716189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e4d8-28e1-4bde-80d8-36d4a9d6be3c service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.724763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 802/1602] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:52 2022] PUT /identity/v3/projects/91ff9725b24d4f4497fb30b5be5f5042/users/55e65624f420449d98bc45a04cba77f3/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:52.725864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.739015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:52.797016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.798369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.798821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:52.798936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.799158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.799950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.801669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.814387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 801/1603] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:52.815357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.825227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646d3df-43f1-41a2-a3ef-d052ee6d3af7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.829772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b215ce4-61d9-4b31-ab7b-f304a8eac0e5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:52.832759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.834456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.835034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:52.835361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.835781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:52.836092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:52.836371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.837171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] PATH_INFO: `/v3/projects/50e9456d87f7446593f2e09b71de4c61/users/726a1e35b0ba437db464fbe108b0cd77/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:52.837362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.839421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.857713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e9456d87f7446593f2e09b71de4c61, user_id=726a1e35b0ba437db464fbe108b0cd77, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:52.861432 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:52.925469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 802/1604] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:52 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:52.926546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.983461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 803/1605] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:52 2022] PUT /identity/v3/projects/50e9456d87f7446593f2e09b71de4c61/users/726a1e35b0ba437db464fbe108b0cd77/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:52.984566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:52.993004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde1a21a-b311-43e7-9939-c77fe8378c8b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:53.056278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4515e06-8b87-4e4b-9887-59063b83c194 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:53.062294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac990a1-a93d-41a7-a493-bf5d41e1c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:53.062978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac990a1-a93d-41a7-a493-bf5d41e1c04b admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.063266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac990a1-a93d-41a7-a493-bf5d41e1c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.063547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac990a1-a93d-41a7-a493-bf5d41e1c04b admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.064278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac990a1-a93d-41a7-a493-bf5d41e1c04b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:53.066543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac990a1-a93d-41a7-a493-bf5d41e1c04b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:53.085713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 804/1606] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:53.087153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ce35-15b5-462c-b664-7671afdb839b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.087556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ce35-15b5-462c-b664-7671afdb839b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.087849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355ce35-15b5-462c-b664-7671afdb839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.092894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:53.094243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.094819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.095115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] PATH_INFO: `/v3/projects/7a8f1ae070cc48b8beb4762431c88e01/users/9332c692614b4b0481daf32906128bc8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.118275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8f1ae070cc48b8beb4762431c88e01, user_id=9332c692614b4b0481daf32906128bc8, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:53.121502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:53.124042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1355ce35-15b5-462c-b664-7671afdb839b None None] MFA Rules not processed for user `55e65624f420449d98bc45a04cba77f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:53.126180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1355ce35-15b5-462c-b664-7671afdb839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:53.204966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 803/1607] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:52 2022] PUT /identity/v3/projects/7a8f1ae070cc48b8beb4762431c88e01/users/9332c692614b4b0481daf32906128bc8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:53.205704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:53.209845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 805/1608] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:53.210831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ce35-15b5-462c-b664-7671afdb839b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:53.227530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355ce35-15b5-462c-b664-7671afdb839b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:53.235837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:53.297395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81bb039-fb38-48ea-9814-929d0bfd11ec admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:53.298850 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:53.303902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166d943-6107-4d00-938f-84e81789ab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:53.305110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d943-6107-4d00-938f-84e81789ab3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.305657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d943-6107-4d00-938f-84e81789ab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.306099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166d943-6107-4d00-938f-84e81789ab3d admin admin] PATH_INFO: `/v3/projects/e86d545389bf4f2b80fe1b7fc28999b0/users/c5b4ecdcad564f6087be90dc60b0e3e7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.311206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:53.314831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.314831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.314831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.314831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:53.315964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:53.326612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d943-6107-4d00-938f-84e81789ab3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e86d545389bf4f2b80fe1b7fc28999b0, user_id=c5b4ecdcad564f6087be90dc60b0e3e7, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:53.331193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166d943-6107-4d00-938f-84e81789ab3d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:53.421903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 804/1609] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:53 2022] PUT /identity/v3/projects/e86d545389bf4f2b80fe1b7fc28999b0/users/c5b4ecdcad564f6087be90dc60b0e3e7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:53.434759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eb89c-12ec-4c54-a654-3b0faa2c8d9e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.435684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eb89c-12ec-4c54-a654-3b0faa2c8d9e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.436114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714eb89c-12ec-4c54-a654-3b0faa2c8d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.455067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-714eb89c-12ec-4c54-a654-3b0faa2c8d9e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:53.456483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-714eb89c-12ec-4c54-a654-3b0faa2c8d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:53.475730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 806/1610] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:53 2022] POST /identity/v3/users => generated 309 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:53.475730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:53.485924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18bbd58-797b-4ce4-8436-77adc215ee20 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:53.568326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56643d41-de08-4252-83ee-c6689d4270af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:53.568326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643d41-de08-4252-83ee-c6689d4270af admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.568326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643d41-de08-4252-83ee-c6689d4270af admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.568326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56643d41-de08-4252-83ee-c6689d4270af admin admin] PATH_INFO: `/v3/projects/fbffe52d5d97449ba20edd371e584158/users/76c17bc3bd974f969fe6df31035e29d9/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.595023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 805/1611] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:53.595023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66cdd-8228-45c0-b496-20d8bedac47c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.595023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66cdd-8228-45c0-b496-20d8bedac47c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.595023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b66cdd-8228-45c0-b496-20d8bedac47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.604999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56643d41-de08-4252-83ee-c6689d4270af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbffe52d5d97449ba20edd371e584158, user_id=76c17bc3bd974f969fe6df31035e29d9, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:53.608835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56643d41-de08-4252-83ee-c6689d4270af admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:53.625738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-87b66cdd-8228-45c0-b496-20d8bedac47c None None] MFA Rules not processed for user `9332c692614b4b0481daf32906128bc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:53.627040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-87b66cdd-8228-45c0-b496-20d8bedac47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:53.726202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 807/1612] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:53 2022] PUT /identity/v3/projects/fbffe52d5d97449ba20edd371e584158/users/76c17bc3bd974f969fe6df31035e29d9/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:53.733615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 806/1613] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:53.735269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638d1e0-dadf-4b89-9c39-345a54eef664 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.735654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638d1e0-dadf-4b89-9c39-345a54eef664 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.736433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638d1e0-dadf-4b89-9c39-345a54eef664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.739643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99c10-e538-4e2f-887f-a56e1970617c None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.739985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99c10-e538-4e2f-887f-a56e1970617c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.740274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a99c10-e538-4e2f-887f-a56e1970617c None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.745141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 808/1614] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 2 13:53:53 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:53:53.745946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99c10-e538-4e2f-887f-a56e1970617c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:53.775547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5638d1e0-dadf-4b89-9c39-345a54eef664 None None] MFA Rules not processed for user `c5b4ecdcad564f6087be90dc60b0e3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:53.777343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5638d1e0-dadf-4b89-9c39-345a54eef664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:53.841081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a99c10-e538-4e2f-887f-a56e1970617c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:53.846641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92237b6-e07a-4749-a245-9d3f437d50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:53.847412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92237b6-e07a-4749-a245-9d3f437d50cf admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.847691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92237b6-e07a-4749-a245-9d3f437d50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.847978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92237b6-e07a-4749-a245-9d3f437d50cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.848928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92237b6-e07a-4749-a245-9d3f437d50cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:53.850918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92237b6-e07a-4749-a245-9d3f437d50cf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:53.865453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 807/1615] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:53.865453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638d1e0-dadf-4b89-9c39-345a54eef664 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:53.866938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 809/1616] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:53.868348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f664ab-4729-457e-b46a-5b5698bd78f1 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.868693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f664ab-4729-457e-b46a-5b5698bd78f1 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.868981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f664ab-4729-457e-b46a-5b5698bd78f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.900762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f2f664ab-4729-457e-b46a-5b5698bd78f1 None None] MFA Rules not processed for user `76c17bc3bd974f969fe6df31035e29d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:53.902090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f2f664ab-4729-457e-b46a-5b5698bd78f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:53.930480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638d1e0-dadf-4b89-9c39-345a54eef664 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:53.934738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:53.936040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.936519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.936842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:53.947505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:53.949294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:53.961768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 808/1617] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:53.962476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:53.989777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 810/1618] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:53.991082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94cc65-dc2c-4c1d-b91d-1b2b97af5c8d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:53.991370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94cc65-dc2c-4c1d-b91d-1b2b97af5c8d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:53.991650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94cc65-dc2c-4c1d-b91d-1b2b97af5c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.024230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3f94cc65-dc2c-4c1d-b91d-1b2b97af5c8d None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:54.026329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3f94cc65-dc2c-4c1d-b91d-1b2b97af5c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:54.037720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:54.063630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e199b9c-85d4-4736-8d67-ed686d6729c3 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.070505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.071522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.073662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.073662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.137377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:54.160855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 811/1619] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 2 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:54.161877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94cc65-dc2c-4c1d-b91d-1b2b97af5c8d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.174100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94cc65-dc2c-4c1d-b91d-1b2b97af5c8d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.179179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.179851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.180138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.180470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.181312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.183374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.184777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.194299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.205900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 809/1620] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:54.206833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.218456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27727282-6420-4ecf-b304-9bb9e33be323 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.238639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.239954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.243499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.244205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] PATH_INFO: `/v3/projects/f3601283090a4b66b80f30ac9c968d6d/users/e41196c13ac74b15b065c71da49692a4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.266727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3601283090a4b66b80f30ac9c968d6d, user_id=e41196c13ac74b15b065c71da49692a4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.271781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.318919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 812/1621] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:54 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:54.320254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.353242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 810/1622] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:54 2022] PUT /identity/v3/projects/f3601283090a4b66b80f30ac9c968d6d/users/e41196c13ac74b15b065c71da49692a4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:54.360255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.494184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814cbaa-6f9d-4af1-be6c-2214a98d79fa admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.521420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98d045-6c9d-41d5-afae-bbce1d526fb2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.527659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.528372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.528930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.529256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.584573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.585252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.586262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.586262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.586697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.602576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.628567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.630212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.657438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 811/1623] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:54.657438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.686192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e346e-a764-4a07-96e6-ddbe25f9be41 service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.702055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.702687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.702973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.703253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.704567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.706856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.739858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 813/1624] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:53:54 2022] POST /identity/v3/projects => generated 385 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:54.741192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.882527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59036-ee19-48d2-ba27-90b7fa170e69 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.884875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 812/1625] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:54 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:54.885704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.892837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.892837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.893028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.893807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.894703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.896599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.909753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 814/1626] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:54.910270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897bb3b-10c7-4f95-a6c5-624a35e5ef4e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.910715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:54.923180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9047993-8eaa-4885-80be-9503ee3688bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.923985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047993-8eaa-4885-80be-9503ee3688bb admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.924282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047993-8eaa-4885-80be-9503ee3688bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.924604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9047993-8eaa-4885-80be-9503ee3688bb admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.925306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9047993-8eaa-4885-80be-9503ee3688bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.926151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a63b9c-7971-49b3-b57b-e0e1c5cd5370 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:54.930648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9047993-8eaa-4885-80be-9503ee3688bb admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.932125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:54.933909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:54.934201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:54.934529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:54.935843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:54.938256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:54.995692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 815/1627] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:54.999136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.024446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8296789-a290-4271-99ef-1c51ebf5d922 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.031063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.031989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.032725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.032891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] PATH_INFO: `/v3/projects/f3601283090a4b66b80f30ac9c968d6d/users/e41196c13ac74b15b065c71da49692a4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.035150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3601283090a4b66b80f30ac9c968d6d, user_id=e41196c13ac74b15b065c71da49692a4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.035598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:55.038209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.054598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 816/1628] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:54 2022] PUT /identity/v3/projects/f3601283090a4b66b80f30ac9c968d6d/users/e41196c13ac74b15b065c71da49692a4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:55.055512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.071281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 813/1629] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:53:54 2022] POST /identity/v3/users => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:53:55.073023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1753-9dcc-4f39-8a98-cea5aa8e6678 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.073623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1753-9dcc-4f39-8a98-cea5aa8e6678 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.076720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c1753-9dcc-4f39-8a98-cea5aa8e6678 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.078868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 814/1630] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 2 13:53:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:53:55.082849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35833bdf-bff1-4674-a129-887707b39450 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.083423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35833bdf-bff1-4674-a129-887707b39450 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.083932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35833bdf-bff1-4674-a129-887707b39450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.122431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-35833bdf-bff1-4674-a129-887707b39450 None None] MFA Rules not processed for user `e41196c13ac74b15b065c71da49692a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:55.125177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-35833bdf-bff1-4674-a129-887707b39450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:55.202973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:55.210487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64939f6-5d35-4dda-81ee-2799c10a5376 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.218963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 815/1631] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:55 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:55.220574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35833bdf-bff1-4674-a129-887707b39450 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.233580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35833bdf-bff1-4674-a129-887707b39450 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.539860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.539860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.539860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.539860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] PATH_INFO: `/v3/projects/26fefb258b5b40ef8778e240396c6264/users/f9e2ec8d31da4d4690c9f7b2d0d6b1f0/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.544143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df35721-cf13-4e2d-9734-6d15fa7270e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.544143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df35721-cf13-4e2d-9734-6d15fa7270e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.544143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df35721-cf13-4e2d-9734-6d15fa7270e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.544143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df35721-cf13-4e2d-9734-6d15fa7270e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.546189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df35721-cf13-4e2d-9734-6d15fa7270e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.546189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df35721-cf13-4e2d-9734-6d15fa7270e8 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.546189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 816/1632] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:55.546189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a587ec0-02d2-4378-93de-16d41ef7ba6d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.546189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a587ec0-02d2-4378-93de-16d41ef7ba6d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.546189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a587ec0-02d2-4378-93de-16d41ef7ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.547950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4a587ec0-02d2-4378-93de-16d41ef7ba6d None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:55.547950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4a587ec0-02d2-4378-93de-16d41ef7ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:55.548508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fefb258b5b40ef8778e240396c6264, user_id=f9e2ec8d31da4d4690c9f7b2d0d6b1f0, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.548508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.549219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 817/1633] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:53:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:55.549219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a587ec0-02d2-4378-93de-16d41ef7ba6d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.549219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a587ec0-02d2-4378-93de-16d41ef7ba6d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.549219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.550067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.550067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.550067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.550067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.555237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 817/1634] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:55 2022] PUT /identity/v3/projects/26fefb258b5b40ef8778e240396c6264/users/f9e2ec8d31da4d4690c9f7b2d0d6b1f0/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:55.558615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.558798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.559070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 818/1635] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:55 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:55.559070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.559070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85be8bd-faba-45b7-a55d-14aae4c71f19 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.627618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b587742-165e-4e44-9b11-8373448c7a29 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.648882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.657807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.657807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.657807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] PATH_INFO: `/v3/projects/297913329c404b9d87455b3203e2753c/users/9872e655057e42b3b23bc17ccbed3a55/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.660943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.661636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.661927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.662546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.662948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.666143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.679580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297913329c404b9d87455b3203e2753c, user_id=9872e655057e42b3b23bc17ccbed3a55, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.680257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 819/1636] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:55.684452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.686871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.725011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:55.758208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d7dec-4e5c-445f-9325-80d4d07cb9b2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.762708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.763510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.764494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.764922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.781198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 818/1637] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:55 2022] PUT /identity/v3/projects/297913329c404b9d87455b3203e2753c/users/9872e655057e42b3b23bc17ccbed3a55/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:55.785436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.854622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.856007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.871275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 820/1638] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:55.872285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.884799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884da3b-f4b8-47b1-9af0-2468cba9ab36 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.884875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cd971-b994-43ea-b69c-6eb5a402556a service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.889419 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.890115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.890377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.890663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.890872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364bb66-d048-4d97-afa2-bd8683a68504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.891403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.892441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364bb66-d048-4d97-afa2-bd8683a68504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.892547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364bb66-d048-4d97-afa2-bd8683a68504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.892945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364bb66-d048-4d97-afa2-bd8683a68504 admin admin] PATH_INFO: `/v3/projects/26fefb258b5b40ef8778e240396c6264/users/f9e2ec8d31da4d4690c9f7b2d0d6b1f0/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.893196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.895489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364bb66-d048-4d97-afa2-bd8683a68504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fefb258b5b40ef8778e240396c6264, user_id=f9e2ec8d31da4d4690c9f7b2d0d6b1f0, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.898283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364bb66-d048-4d97-afa2-bd8683a68504 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.905396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 821/1639] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:53:55.909355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:55.924284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ce356-de24-446c-bd96-de703c60a211 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:55.930280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ca16a-151e-4d99-b063-361ab05114e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:55.931540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca16a-151e-4d99-b063-361ab05114e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.931907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca16a-151e-4d99-b063-361ab05114e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.932263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ca16a-151e-4d99-b063-361ab05114e5 admin admin] PATH_INFO: `/v3/projects/297913329c404b9d87455b3203e2753c/users/9872e655057e42b3b23bc17ccbed3a55/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.934956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca16a-151e-4d99-b063-361ab05114e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=297913329c404b9d87455b3203e2753c, user_id=9872e655057e42b3b23bc17ccbed3a55, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:55.938683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ca16a-151e-4d99-b063-361ab05114e5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:55.952212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 819/1640] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:55 2022] PUT /identity/v3/projects/26fefb258b5b40ef8778e240396c6264/users/f9e2ec8d31da4d4690c9f7b2d0d6b1f0/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:55.962695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 822/1641] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:53:55 2022] PUT /identity/v3/projects/297913329c404b9d87455b3203e2753c/users/9872e655057e42b3b23bc17ccbed3a55/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:55.962905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1b06f-8d8d-4e02-88b1-480dfc75341f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.963106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1b06f-8d8d-4e02-88b1-480dfc75341f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.963354 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1b06f-8d8d-4e02-88b1-480dfc75341f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:55.964647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338263df-b3b4-424c-95cb-738c0dd1054f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:55.965019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338263df-b3b4-424c-95cb-738c0dd1054f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:55.965375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338263df-b3b4-424c-95cb-738c0dd1054f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:56.005356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-338263df-b3b4-424c-95cb-738c0dd1054f None None] MFA Rules not processed for user `9872e655057e42b3b23bc17ccbed3a55`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:56.006699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-338263df-b3b4-424c-95cb-738c0dd1054f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:56.036368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-52e1b06f-8d8d-4e02-88b1-480dfc75341f None None] MFA Rules not processed for user `f9e2ec8d31da4d4690c9f7b2d0d6b1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:56.040349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-52e1b06f-8d8d-4e02-88b1-480dfc75341f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:56.110842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 823/1642] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:56.293702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 820/1643] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:56.332818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338263df-b3b4-424c-95cb-738c0dd1054f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:56.474079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338263df-b3b4-424c-95cb-738c0dd1054f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:56.499952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:56.501161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:56.502938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:56.503336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:56.540743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:56.544804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:56.562115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:56.607645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 824/1644] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:56.650895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1b06f-8d8d-4e02-88b1-480dfc75341f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:56.729909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:56.743235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72279fd-5c84-4184-a0e0-18057d6c823b service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:56.752790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7c83d-0d0a-4d9e-bd40-fd729e8b5a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:56.753888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c83d-0d0a-4d9e-bd40-fd729e8b5a06 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:56.754609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c83d-0d0a-4d9e-bd40-fd729e8b5a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:56.755102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7c83d-0d0a-4d9e-bd40-fd729e8b5a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:56.777976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7c83d-0d0a-4d9e-bd40-fd729e8b5a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:56.791518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7c83d-0d0a-4d9e-bd40-fd729e8b5a06 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:56.798661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1b06f-8d8d-4e02-88b1-480dfc75341f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:56.807645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:56.808623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:56.809027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:56.809219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] PATH_INFO: `/v3/users/76c17bc3bd974f969fe6df31035e29d9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:56.810509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c17bc3bd974f969fe6df31035e29d9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:56.811777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: WARNING py.warnings [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:53:56.811777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: warnings.warn(msg) Jun 02 13:53:56.811777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: Jun 02 13:53:56.813804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:56.817502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 825/1645] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:53:56.819470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffcd65-fcf3-4add-ab23-a65b2d681b11 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:56.819975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffcd65-fcf3-4add-ab23-a65b2d681b11 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:56.821577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffcd65-fcf3-4add-ab23-a65b2d681b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:56.878458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-08ffcd65-fcf3-4add-ab23-a65b2d681b11 None None] MFA Rules not processed for user `726a1e35b0ba437db464fbe108b0cd77`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:56.882739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-08ffcd65-fcf3-4add-ab23-a65b2d681b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:56.984017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:57.035142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 826/1646] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:57.049841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44997660-34b2-4288-9e1f-84a0677c3df8 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.049841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44997660-34b2-4288-9e1f-84a0677c3df8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.049841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44997660-34b2-4288-9e1f-84a0677c3df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.096934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-44997660-34b2-4288-9e1f-84a0677c3df8 None None] MFA Rules not processed for user `726a1e35b0ba437db464fbe108b0cd77`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:57.098307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-44997660-34b2-4288-9e1f-84a0677c3df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:57.115445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c17bc3bd974f969fe6df31035e29d9'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.123854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 827/1647] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:53:57.123854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44997660-34b2-4288-9e1f-84a0677c3df8 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:57.148685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44997660-34b2-4288-9e1f-84a0677c3df8 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:57.164736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:57.167002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.171058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.171585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] PATH_INFO: `/v3/users/a43cd6021eca4bbbb6b07f4374e4b79b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.173424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43cd6021eca4bbbb6b07f4374e4b79b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:57.175430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:57.202046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c17bc3bd974f969fe6df31035e29d9'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.224771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c17bc3bd974f969fe6df31035e29d9'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.252598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c17bc3bd974f969fe6df31035e29d9'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.253375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-374b8cba-632c-44ee-b047-e2fe02775c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c17bc3bd974f969fe6df31035e29d9'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.264932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 821/1648] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:53:56 2022] DELETE /identity/v3/users/76c17bc3bd974f969fe6df31035e29d9 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:57.266806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e8b2-b578-492e-af6a-ea47b023fb19 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.267155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e8b2-b578-492e-af6a-ea47b023fb19 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.273098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63e8b2-b578-492e-af6a-ea47b023fb19 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.273098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 822/1649] 10.222.0.33 () {54 vars in 961 bytes} [Thu Jun 2 13:53:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:53:57.274877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f5708-c21c-4812-8b80-3d1f5e599edc None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.275410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f5708-c21c-4812-8b80-3d1f5e599edc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.275617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f5708-c21c-4812-8b80-3d1f5e599edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.302656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bf6f5708-c21c-4812-8b80-3d1f5e599edc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:57.305022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bf6f5708-c21c-4812-8b80-3d1f5e599edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:57.384826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43cd6021eca4bbbb6b07f4374e4b79b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.417881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 823/1650] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:57.419438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ef92-d782-44fd-a802-14bece3a6b2b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.423893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ef92-d782-44fd-a802-14bece3a6b2b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.424357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ef92-d782-44fd-a802-14bece3a6b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.468564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43cd6021eca4bbbb6b07f4374e4b79b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.480191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6a92ef92-d782-44fd-a802-14bece3a6b2b None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:57.480191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6a92ef92-d782-44fd-a802-14bece3a6b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:57.492077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43cd6021eca4bbbb6b07f4374e4b79b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.511933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43cd6021eca4bbbb6b07f4374e4b79b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.512698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43cd6021eca4bbbb6b07f4374e4b79b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:57.530100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 828/1651] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:53:57 2022] DELETE /identity/v3/users/a43cd6021eca4bbbb6b07f4374e4b79b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:57.530100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:57.531771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:57.549133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:57.652601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1b110-c49c-4f56-8df2-fe750f329d32 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:57.656735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:57.657409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.657696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.657975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.660236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:57.662013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 824/1652] 10.222.0.33 () {58 vars in 1058 bytes} [Thu Jun 2 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:57.664731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d568-804e-48b9-896e-09a7cb6dc717 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.665038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d568-804e-48b9-896e-09a7cb6dc717 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.665331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d568-804e-48b9-896e-09a7cb6dc717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.693360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6856d568-804e-48b9-896e-09a7cb6dc717 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:57.694602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6856d568-804e-48b9-896e-09a7cb6dc717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:57.789324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:57.790905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:57.811916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 829/1653] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:57.812755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:57.819941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 825/1654] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:57.839927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d568-804e-48b9-896e-09a7cb6dc717 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:57.881050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d568-804e-48b9-896e-09a7cb6dc717 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:57.895320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:57.896071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:57.900885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:57.900885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:57.922918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:57.929705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:57.940009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 826/1655] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:53:57.988689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059f8a1-9bf5-4905-8b5d-6c4155964752 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:58.004170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc35048-60b9-4e81-bd97-3eaa80c12b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:58.005589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc35048-60b9-4e81-bd97-3eaa80c12b26 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:58.005589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc35048-60b9-4e81-bd97-3eaa80c12b26 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:58.005589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc35048-60b9-4e81-bd97-3eaa80c12b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:58.007721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bcc35048-60b9-4e81-bd97-3eaa80c12b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:58.120825 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:58.176071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc35048-60b9-4e81-bd97-3eaa80c12b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:58.177809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc35048-60b9-4e81-bd97-3eaa80c12b26 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:58.204827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 830/1656] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:58.522375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:58.524914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:58.562175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b3b82-bf54-4bc2-b458-4db63ee41460 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:58.569074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:58.569959 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:58.570245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:58.570528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] PATH_INFO: `/v3/users/c5b4ecdcad564f6087be90dc60b0e3e7` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:58.573213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b4ecdcad564f6087be90dc60b0e3e7)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:58.575383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:58.739326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e8b-6f34-4e37-9018-1a40d9234fdc None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:58.739659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e8b-6f34-4e37-9018-1a40d9234fdc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:58.740146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced6e8b-6f34-4e37-9018-1a40d9234fdc None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:58.742631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 831/1657] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 2 13:53:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:53:58.757991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:58.758293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:58.758566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:58.786470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:58.786900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:58.805048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 832/1658] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:53:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:53:58.815403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:58.817405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:58.842344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b4ecdcad564f6087be90dc60b0e3e7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:58.926910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9149b-9775-4c14-afa2-ad151d051c14 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:58.932939 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:58.934100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:58.934989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:58.936158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:58.944942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b4ecdcad564f6087be90dc60b0e3e7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:58.955317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:58.958002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:58.982692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 833/1659] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:53:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:53:58.982692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:58.985733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:58.987521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b4ecdcad564f6087be90dc60b0e3e7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.021670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b4ecdcad564f6087be90dc60b0e3e7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.023694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b4ecdcad564f6087be90dc60b0e3e7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.024703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464e222-2be2-4d8a-93e4-acd6ef8487ff service glance] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:59.036990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:59.039683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:59.041220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:59.041220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] PATH_INFO: `/v3/projects/c422d8ee8a2e4e369a569fb1599978e7` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:59.042292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 827/1660] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:53:58 2022] DELETE /identity/v3/users/c5b4ecdcad564f6087be90dc60b0e3e7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:59.043179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:59.043825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c422d8ee8a2e4e369a569fb1599978e7)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:59.047285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: WARNING py.warnings [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 02 13:53:59.047285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: warnings.warn(msg) Jun 02 13:53:59.047285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: Jun 02 13:53:59.047614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:59.049629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:59.224472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57d473-68be-44e5-b660-4e1bd34797e3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:59.251706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:59.254910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:59.256871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:59.258426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] PATH_INFO: `/v3/projects/fbffe52d5d97449ba20edd371e584158` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:59.263158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbffe52d5d97449ba20edd371e584158)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:59.269419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:59.285902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c422d8ee8a2e4e369a569fb1599978e7', 'request_id': 'req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.322371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c422d8ee8a2e4e369a569fb1599978e7', 'request_id': 'req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.429181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c422d8ee8a2e4e369a569fb1599978e7', 'request_id': 'req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.458748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] The token cache is being invalidate because project c422d8ee8a2e4e369a569fb1599978e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:53:59.459060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.460183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b9ffec17-38f8-4f41-9c9e-8dcb3647db5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.461460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbffe52d5d97449ba20edd371e584158', 'request_id': 'req-01195550-124f-442c-b77c-ed436129ae14'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.462495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 834/1661] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:53:58 2022] DELETE /identity/v3/projects/c422d8ee8a2e4e369a569fb1599978e7 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:59.468935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19bddf-0478-406c-8308-2d660c9480ce None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:59.469231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19bddf-0478-406c-8308-2d660c9480ce None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:59.469513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19bddf-0478-406c-8308-2d660c9480ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:59.473623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbffe52d5d97449ba20edd371e584158', 'request_id': 'req-01195550-124f-442c-b77c-ed436129ae14'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.514550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ac19bddf-0478-406c-8308-2d660c9480ce None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:53:59.515872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ac19bddf-0478-406c-8308-2d660c9480ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:59.549340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbffe52d5d97449ba20edd371e584158', 'request_id': 'req-01195550-124f-442c-b77c-ed436129ae14'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.569676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] The token cache is being invalidate because project fbffe52d5d97449ba20edd371e584158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:53:59.582185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.599546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:53:59.602663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 828/1662] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:53:59 2022] DELETE /identity/v3/projects/fbffe52d5d97449ba20edd371e584158 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:53:59.603699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:59.605215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:59.638008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:59.741900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01195550-124f-442c-b77c-ed436129ae14 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:59.742269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 835/1663] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:53:59.746530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e526-5a99-4e65-af8c-eb6c317105cc None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:59.746687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e526-5a99-4e65-af8c-eb6c317105cc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:59.746977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e526-5a99-4e65-af8c-eb6c317105cc None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:59.747141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:59.748692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:59.748692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:59.748967 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] PATH_INFO: `/v3/users/e41196c13ac74b15b065c71da49692a4` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:59.750383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e41196c13ac74b15b065c71da49692a4)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:59.750927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 836/1664] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 2 13:53:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:53:59.754452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:53:59.755238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:53:59.760886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e526-5a99-4e65-af8c-eb6c317105cc None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:53:59.766564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-94c5e526-5a99-4e65-af8c-eb6c317105cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:53:59.811103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e526-5a99-4e65-af8c-eb6c317105cc None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:53:59.830138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:53:59.830330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:53:59.830753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:53:59.831459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] PATH_INFO: `/v3/users/9872e655057e42b3b23bc17ccbed3a55` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:53:59.833279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9872e655057e42b3b23bc17ccbed3a55)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:53:59.835477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:00.037409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e41196c13ac74b15b065c71da49692a4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.124601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9872e655057e42b3b23bc17ccbed3a55'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.182273 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e41196c13ac74b15b065c71da49692a4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.198601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e41196c13ac74b15b065c71da49692a4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.206849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e41196c13ac74b15b065c71da49692a4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.207820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e41196c13ac74b15b065c71da49692a4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.214420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 829/1665] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:53:59 2022] DELETE /identity/v3/users/e41196c13ac74b15b065c71da49692a4 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:00.215432 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:00.220129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:00.311723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fdf95-920b-4796-888c-9b83e65b5af6 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:00.315391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9872e655057e42b3b23bc17ccbed3a55'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.320279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:00.324989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:00.324989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:00.324989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:00.327913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:00.359602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9872e655057e42b3b23bc17ccbed3a55'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.391427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9872e655057e42b3b23bc17ccbed3a55'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.392247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a858520-ff19-4a82-a427-9f60a76e0d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9872e655057e42b3b23bc17ccbed3a55'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:00.402565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 837/1666] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:53:59 2022] DELETE /identity/v3/users/9872e655057e42b3b23bc17ccbed3a55 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:00.403704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:00.406847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:00.407160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:00.494270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] MFA Rules not processed for user `d7b2b76c46b640c0b19b46ed50d333ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:00.499109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:00.550918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:00.557420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:00.564890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 830/1667] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:00.604453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 838/1668] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:54:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:00.662438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:00.676300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02679-241b-42c8-9960-226d217acd4e service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:00.688880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9ff0b-4690-4bad-ba90-209463757604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:00.689703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9ff0b-4690-4bad-ba90-209463757604 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:00.689999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9ff0b-4690-4bad-ba90-209463757604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:00.690283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9ff0b-4690-4bad-ba90-209463757604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:00.710501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9ff0b-4690-4bad-ba90-209463757604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:00.711097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9ff0b-4690-4bad-ba90-209463757604 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:00.721127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 831/1669] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:01.315368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:01.317353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:01.482525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5faf5-c363-4253-b808-34055a458dd8 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:01.497873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:01.497873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:01.497873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:01.497873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] PATH_INFO: `/v3/projects/f3601283090a4b66b80f30ac9c968d6d` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:01.500888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3601283090a4b66b80f30ac9c968d6d)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:01.505793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:01.570879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:01.571387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:01.571658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:01.635612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] MFA Rules not processed for user `4dd10f5fa400450fb64360391a871bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:01.637107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:01.683694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3601283090a4b66b80f30ac9c968d6d', 'request_id': 'req-8dca2d3c-9571-4768-9948-ffb7af9eec65'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:01.698466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3601283090a4b66b80f30ac9c968d6d', 'request_id': 'req-8dca2d3c-9571-4768-9948-ffb7af9eec65'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:01.761121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 832/1670] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:01.770858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:01.776918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:01.786144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3601283090a4b66b80f30ac9c968d6d', 'request_id': 'req-8dca2d3c-9571-4768-9948-ffb7af9eec65'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:01.812913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] The token cache is being invalidate because project f3601283090a4b66b80f30ac9c968d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:01.816657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:01.818963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:01.826802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 839/1671] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:01 2022] DELETE /identity/v3/projects/f3601283090a4b66b80f30ac9c968d6d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:01.830886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:01.830886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:01.831751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e175c-ad27-45a2-a3eb-137cb8e62f1a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:01.942650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:01.967131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:01.969814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:01.973014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:01.973458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] PATH_INFO: `/v3/users/55e65624f420449d98bc45a04cba77f3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:01.975072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] RBAC: Authorizing `identity:delete_user(user_id=55e65624f420449d98bc45a04cba77f3)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:01.978669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:01.985602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca2d3c-9571-4768-9948-ffb7af9eec65 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:02.017906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:02.019020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:02.019467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:02.020073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] PATH_INFO: `/v3/projects/e86d545389bf4f2b80fe1b7fc28999b0` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:02.022558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e86d545389bf4f2b80fe1b7fc28999b0)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:02.025335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:02.132320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:02.288992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e86d545389bf4f2b80fe1b7fc28999b0', 'request_id': 'req-6959b650-0d97-42ea-9fdd-6f29ee592a24'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.292128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55e65624f420449d98bc45a04cba77f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.318967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e86d545389bf4f2b80fe1b7fc28999b0', 'request_id': 'req-6959b650-0d97-42ea-9fdd-6f29ee592a24'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.415517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55e65624f420449d98bc45a04cba77f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.462309 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55e65624f420449d98bc45a04cba77f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.475507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55e65624f420449d98bc45a04cba77f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.476114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55e65624f420449d98bc45a04cba77f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.485941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 833/1672] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:01 2022] DELETE /identity/v3/users/55e65624f420449d98bc45a04cba77f3 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:02.486721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:02.490345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e86d545389bf4f2b80fe1b7fc28999b0', 'request_id': 'req-6959b650-0d97-42ea-9fdd-6f29ee592a24'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.491093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:02.540617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] The token cache is being invalidate because project e86d545389bf4f2b80fe1b7fc28999b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:02.541246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.542227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:02.547850 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 840/1673] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:01 2022] DELETE /identity/v3/projects/e86d545389bf4f2b80fe1b7fc28999b0 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:02.550094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:02.552209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:02.632751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90556b3-8a93-4246-9b90-c372b608d45b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:02.641366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0ef0d-ede7-4855-926d-dc646941c563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:02.642522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0ef0d-ede7-4855-926d-dc646941c563 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:02.643067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0ef0d-ede7-4855-926d-dc646941c563 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:02.643498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0ef0d-ede7-4855-926d-dc646941c563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:02.647183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a5f0ef0d-ede7-4855-926d-dc646941c563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:02.675615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959b650-0d97-42ea-9fdd-6f29ee592a24 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:02.757993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0ef0d-ede7-4855-926d-dc646941c563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:02.759704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0ef0d-ede7-4855-926d-dc646941c563 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:02.782640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 834/1674] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:02.785865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1966-ae5a-47ee-8b0e-a32164e44fb0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:02.787090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1966-ae5a-47ee-8b0e-a32164e44fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:02.787686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1966-ae5a-47ee-8b0e-a32164e44fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:02.816119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:02.817774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:02.818215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:02.819270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] PATH_INFO: `/v3/projects/297913329c404b9d87455b3203e2753c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:02.821839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=297913329c404b9d87455b3203e2753c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:02.824896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:02.840172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-104f1966-ae5a-47ee-8b0e-a32164e44fb0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:02.842299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-104f1966-ae5a-47ee-8b0e-a32164e44fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:02.872325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 835/1675] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:02.875189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647e95-82eb-4298-8e6e-398a2e8d6873 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:02.875681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647e95-82eb-4298-8e6e-398a2e8d6873 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:02.878012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8647e95-82eb-4298-8e6e-398a2e8d6873 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:02.889142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 836/1676] 10.222.0.33 () {54 vars in 960 bytes} [Thu Jun 2 13:54:02 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:02.890816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:02.894212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:02.896272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:02.931815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:02.936793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:02.983830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 837/1677] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:02.993985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:02.996382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.013395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b217a1b-b6f1-46b5-ba22-3d8dc75e5696 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:03.022345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:03.025531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:03.034535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:03.034535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] PATH_INFO: `/v3/users/f9e2ec8d31da4d4690c9f7b2d0d6b1f0` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:03.034535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e2ec8d31da4d4690c9f7b2d0d6b1f0)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:03.034535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:03.059420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297913329c404b9d87455b3203e2753c', 'request_id': 'req-f180566e-158b-470f-9d8e-11e3da97f8a2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.075068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297913329c404b9d87455b3203e2753c', 'request_id': 'req-f180566e-158b-470f-9d8e-11e3da97f8a2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.161444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297913329c404b9d87455b3203e2753c', 'request_id': 'req-f180566e-158b-470f-9d8e-11e3da97f8a2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.164095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:03.183583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] The token cache is being invalidate because project 297913329c404b9d87455b3203e2753c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:03.183583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.185010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f180566e-158b-470f-9d8e-11e3da97f8a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.196217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 841/1678] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:02 2022] DELETE /identity/v3/projects/297913329c404b9d87455b3203e2753c => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:03.198562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff72891-eb8f-47d8-8750-939e647153f6 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:03.201683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff72891-eb8f-47d8-8750-939e647153f6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:03.203018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff72891-eb8f-47d8-8750-939e647153f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:03.234712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8ff72891-eb8f-47d8-8750-939e647153f6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:03.236103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8ff72891-eb8f-47d8-8750-939e647153f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.369826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 842/1679] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:03.371431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:03.372049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:03.372382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:03.375420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e2ec8d31da4d4690c9f7b2d0d6b1f0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.405649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:03.407069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.619648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 843/1680] 10.222.0.33 () {58 vars in 1057 bytes} [Thu Jun 2 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:03.620850 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:03.626393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.628283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e2ec8d31da4d4690c9f7b2d0d6b1f0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.680302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e2ec8d31da4d4690c9f7b2d0d6b1f0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.697495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e2ec8d31da4d4690c9f7b2d0d6b1f0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.698267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6b9408a0-be9f-4d16-a39a-46ea7e777acc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e2ec8d31da4d4690c9f7b2d0d6b1f0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:03.706972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 838/1681] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:02 2022] DELETE /identity/v3/users/f9e2ec8d31da4d4690c9f7b2d0d6b1f0 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:03.709321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:03.709928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:03.710363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:03.737001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:03.739758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.777610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2dbc2d-55f4-4d46-8fa1-8eb87643c1a6 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:03.850761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 839/1682] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:03.852062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:03.853862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.865843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:03.866680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:03.866861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:03.867204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:03.869742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641d91d-5212-48c8-b9ad-95bc91c91c78 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:03.874697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.876139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f60c33-8597-46d8-b725-8d257368e741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:03.877090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f60c33-8597-46d8-b725-8d257368e741 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:03.877573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f60c33-8597-46d8-b725-8d257368e741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:03.878551 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f60c33-8597-46d8-b725-8d257368e741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:03.879671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f60c33-8597-46d8-b725-8d257368e741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:03.891667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f60c33-8597-46d8-b725-8d257368e741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:03.896519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f60c33-8597-46d8-b725-8d257368e741 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:03.902747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:03.904866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:03.916245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 844/1683] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:03.918199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:03.920640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:03.940492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 840/1684] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:03.942878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc561-d008-40ec-b0c5-d290ad40cfca None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:03.946442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc561-d008-40ec-b0c5-d290ad40cfca None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:03.946697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fc561-d008-40ec-b0c5-d290ad40cfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.007410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f10fc561-d008-40ec-b0c5-d290ad40cfca None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:04.011111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f10fc561-d008-40ec-b0c5-d290ad40cfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:04.036742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 841/1685] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:04.038621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fc561-d008-40ec-b0c5-d290ad40cfca None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:04.087162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fc561-d008-40ec-b0c5-d290ad40cfca None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:04.100551 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163a7d03-1d2c-43a1-b695-7cf241ed0234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:04.101525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7d03-1d2c-43a1-b695-7cf241ed0234 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:04.116363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:04.121693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7d03-1d2c-43a1-b695-7cf241ed0234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:04.122149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163a7d03-1d2c-43a1-b695-7cf241ed0234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.123574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a7d03-1d2c-43a1-b695-7cf241ed0234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:04.129427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163a7d03-1d2c-43a1-b695-7cf241ed0234 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:04.168287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408feb42-50b8-4ea8-94d3-c41d66bd4a53 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:04.200768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:04.202420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:04.235538 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:04.238737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.244845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:04.263140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:04.265522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:04.277491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 845/1686] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:04.278088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:04.293046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 842/1687] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:04 2022] POST /identity/v3/projects => generated 379 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:04.293046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9e4e-5158-4265-9016-afae4521ccf6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:04.293395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9e4e-5158-4265-9016-afae4521ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:04.293712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9e4e-5158-4265-9016-afae4521ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.377247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5dfa9e4e-5158-4265-9016-afae4521ccf6 None None] MFA Rules not processed for user `f9e57606c14a4ad99612414c1f9719f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:04.378642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5dfa9e4e-5158-4265-9016-afae4521ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:04.390948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fcbac-b2a7-409d-99b5-be6a1f26f519 service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:04.587976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cffeb5-292b-4dbd-93a4-cf264e0a2896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:04.593478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffeb5-292b-4dbd-93a4-cf264e0a2896 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:04.594447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffeb5-292b-4dbd-93a4-cf264e0a2896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:04.594870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cffeb5-292b-4dbd-93a4-cf264e0a2896 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.596338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cffeb5-292b-4dbd-93a4-cf264e0a2896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:04.598737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cffeb5-292b-4dbd-93a4-cf264e0a2896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:04.601433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cffeb5-292b-4dbd-93a4-cf264e0a2896 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:04.643510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 843/1688] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:04.643510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa9e4e-5158-4265-9016-afae4521ccf6 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:04.662690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 846/1689] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:04.662690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fbd1-d54c-43a9-af3a-6e871e895c86 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:04.662690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fbd1-d54c-43a9-af3a-6e871e895c86 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:04.662690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fbd1-d54c-43a9-af3a-6e871e895c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.671758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa9e4e-5158-4265-9016-afae4521ccf6 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:04.695838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:04.696659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:04.697021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:04.701752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.702729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:04.704940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:04.708192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c874fbd1-d54c-43a9-af3a-6e871e895c86 None None] MFA Rules not processed for user `f9e57606c14a4ad99612414c1f9719f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:04.709676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c874fbd1-d54c-43a9-af3a-6e871e895c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:04.741770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 847/1690] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:04.742945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fbd1-d54c-43a9-af3a-6e871e895c86 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:04.801289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fbd1-d54c-43a9-af3a-6e871e895c86 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:04.851670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 844/1691] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:04 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:04.852479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:04.853479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:04.853690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:04.854192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:04.854921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:04.856139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:04.862167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:04.862582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:04.985136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 848/1692] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:04 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:04.986463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:05.103839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9da9c4-3c36-41a5-b17b-da61c3121b0e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.154896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5f6c9-c67e-40a8-85db-fa0e6ba9e122 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.163065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:05.164203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.168690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.168690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.168690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:05.170975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:05.202726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 849/1693] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:05.207181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:05.226686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:05.227583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.227877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.228158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.230241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd5d51-4b13-448e-91f5-f4e3acf0d27a admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.240884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:05.242115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.243386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.243992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.249862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:05.251923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:05.372473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:05.374437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:05.385258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 845/1694] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:05.386626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:05.398189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0c107-645d-4812-b49f-e077dc0c4dce service nova] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.403940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:05.405002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.405467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.405858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.406759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:05.408610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:05.427527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 846/1695] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:05.428694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:05.430804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:05.454712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 850/1696] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:05 2022] POST /identity/v3/users => generated 294 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:05.455642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:05.462048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab6a5-a8ca-4728-89c0-922c9a3a5166 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.479769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:05.485648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.485648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.485952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:05.486032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] PATH_INFO: `/v3/projects/26fefb258b5b40ef8778e240396c6264` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.486032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fefb258b5b40ef8778e240396c6264)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:05.487950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:05.503809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fa8fc-89dd-495a-87d0-6bd79aa7012e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.520088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:05.523421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.523421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.523421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] PATH_INFO: `/v3/projects/69bd2650f6574f4a861d1681a4eddbc0/users/6e3be654b5e6494b9fd85a8042d31eb4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.566869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69bd2650f6574f4a861d1681a4eddbc0, user_id=6e3be654b5e6494b9fd85a8042d31eb4, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:05.569471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:05.646229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 851/1697] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:05 2022] PUT /identity/v3/projects/69bd2650f6574f4a861d1681a4eddbc0/users/6e3be654b5e6494b9fd85a8042d31eb4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:05.646229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:05.683780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fefb258b5b40ef8778e240396c6264', 'request_id': 'req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:05.703529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fefb258b5b40ef8778e240396c6264', 'request_id': 'req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:05.805666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a5c27-f8ee-46ce-b6f5-67d21d807e6b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.828292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fefb258b5b40ef8778e240396c6264', 'request_id': 'req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:05.850566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] The token cache is being invalidate because project 26fefb258b5b40ef8778e240396c6264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:05.850915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:05.851591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:05.853723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 847/1698] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:05 2022] DELETE /identity/v3/projects/26fefb258b5b40ef8778e240396c6264 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:05.854761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:05.856257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:05.908930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383b2f0-2df0-418e-8ae7-aaab601c98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:05.909681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b2f0-2df0-418e-8ae7-aaab601c98d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.909976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b2f0-2df0-418e-8ae7-aaab601c98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.910451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383b2f0-2df0-418e-8ae7-aaab601c98d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.911204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b2f0-2df0-418e-8ae7-aaab601c98d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:05.913007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383b2f0-2df0-418e-8ae7-aaab601c98d9 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:05.930176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 852/1699] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:05.932706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943f0d-16d8-4a10-b1b6-7c8eac0d0918 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:05.933070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943f0d-16d8-4a10-b1b6-7c8eac0d0918 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:05.942802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f943f0d-16d8-4a10-b1b6-7c8eac0d0918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:05.991617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3f38d-d7de-484a-aa49-7e7331e73a3b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:05.994405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6f943f0d-16d8-4a10-b1b6-7c8eac0d0918 None None] MFA Rules not processed for user `6e3be654b5e6494b9fd85a8042d31eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:05.996101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6f943f0d-16d8-4a10-b1b6-7c8eac0d0918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:06.002447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:06.003593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.004200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.006805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] PATH_INFO: `/v3/projects/91ff9725b24d4f4497fb30b5be5f5042` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.008554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] RBAC: Authorizing `identity:delete_project(project_id=91ff9725b24d4f4497fb30b5be5f5042)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:06.012579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:06.137759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 853/1700] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:06.139603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.140164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.140675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.162675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:06.163981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:06.195377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 854/1701] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:06.198648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:06.206184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:06.222359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91ff9725b24d4f4497fb30b5be5f5042', 'request_id': 'req-e2f59116-3b94-4613-b239-2aac9cb7800e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:06.231679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954259b-e37c-45f2-9219-edb93a6afba3 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:06.234019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91ff9725b24d4f4497fb30b5be5f5042', 'request_id': 'req-e2f59116-3b94-4613-b239-2aac9cb7800e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:06.343846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91ff9725b24d4f4497fb30b5be5f5042', 'request_id': 'req-e2f59116-3b94-4613-b239-2aac9cb7800e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:06.372989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] The token cache is being invalidate because project 91ff9725b24d4f4497fb30b5be5f5042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:06.373406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:06.375263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:06.376767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 848/1702] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:05 2022] DELETE /identity/v3/projects/91ff9725b24d4f4497fb30b5be5f5042 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:06.377658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:06.383503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c89677-1a00-4a68-8b3e-19d515ea9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:06.384208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89677-1a00-4a68-8b3e-19d515ea9896 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.384533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89677-1a00-4a68-8b3e-19d515ea9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.384820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89677-1a00-4a68-8b3e-19d515ea9896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.385569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c89677-1a00-4a68-8b3e-19d515ea9896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:06.387404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c89677-1a00-4a68-8b3e-19d515ea9896 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:06.392389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:06.403482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 855/1703] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:06.405668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945083d-2e48-48e9-b852-ccdd3c901305 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.409635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945083d-2e48-48e9-b852-ccdd3c901305 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.409635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945083d-2e48-48e9-b852-ccdd3c901305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.421640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f59116-3b94-4613-b239-2aac9cb7800e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:06.430582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:06.433417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c945083d-2e48-48e9-b852-ccdd3c901305 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:06.441894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c945083d-2e48-48e9-b852-ccdd3c901305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:06.442328 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:06.442328 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.442779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.442779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.443543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:06.447564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 856/1704] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:06.447564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.447564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.447564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.448009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:06.513048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:06.516230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:06.526418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 857/1705] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:06.527547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:06.529905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:06.554011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ed5ce-3540-44e8-8151-e40f768bba8a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:06.572500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5790d0-42bf-4bd8-91ef-afe28f74bad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:06.574467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5790d0-42bf-4bd8-91ef-afe28f74bad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.575005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5790d0-42bf-4bd8-91ef-afe28f74bad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.575508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5790d0-42bf-4bd8-91ef-afe28f74bad7 admin admin] PATH_INFO: `/v3/projects/c0da5333f4e149e29d44592a4a479cf2/users/c14368ffd9d541f4b166decbb3826eff/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.606984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 849/1706] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:06 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:06.606984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:06.662156 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5790d0-42bf-4bd8-91ef-afe28f74bad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0da5333f4e149e29d44592a4a479cf2, user_id=c14368ffd9d541f4b166decbb3826eff, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:06.678136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5790d0-42bf-4bd8-91ef-afe28f74bad7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:06.824540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e826-257f-4d66-a8c6-b20c68c5720a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:06.838042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:06.839326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.839849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.840311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.841514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:06.842944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:06.845573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:06.848245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 858/1707] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:06 2022] PUT /identity/v3/projects/c0da5333f4e149e29d44592a4a479cf2/users/c14368ffd9d541f4b166decbb3826eff/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:06.852476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174e29-2b04-4fd3-89ae-841cf74c4d49 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:06.853793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174e29-2b04-4fd3-89ae-841cf74c4d49 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:06.854229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29174e29-2b04-4fd3-89ae-841cf74c4d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:06.867937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 850/1708] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:06.867937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:06.879654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bfb1f1-f126-4485-812b-f6393512ba5b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:06.929727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-29174e29-2b04-4fd3-89ae-841cf74c4d49 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:06.939725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-29174e29-2b04-4fd3-89ae-841cf74c4d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:07.003657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e70e64a-b743-4aee-a6c6-c3d16ba39b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.004358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e64a-b743-4aee-a6c6-c3d16ba39b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.004692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e64a-b743-4aee-a6c6-c3d16ba39b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.005040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e70e64a-b743-4aee-a6c6-c3d16ba39b43 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.005890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70e64a-b743-4aee-a6c6-c3d16ba39b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.026527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e70e64a-b743-4aee-a6c6-c3d16ba39b43 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.110291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 859/1709] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:07.110291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5d62-5cb2-489f-a90b-99961fccfb64 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.110291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5d62-5cb2-489f-a90b-99961fccfb64 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.110291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a5d62-5cb2-489f-a90b-99961fccfb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.133404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 851/1710] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:06 2022] POST /identity/v3/users => generated 297 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:07.134983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed3d28-fe2b-4e2d-a911-3d5f30ed7c2f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.135421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed3d28-fe2b-4e2d-a911-3d5f30ed7c2f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.135809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed3d28-fe2b-4e2d-a911-3d5f30ed7c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.155549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-751a5d62-5cb2-489f-a90b-99961fccfb64 None None] MFA Rules not processed for user `f9e57606c14a4ad99612414c1f9719f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:07.156726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-751a5d62-5cb2-489f-a90b-99961fccfb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:07.174415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:07.215384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ffed3d28-fe2b-4e2d-a911-3d5f30ed7c2f None None] MFA Rules not processed for user `c14368ffd9d541f4b166decbb3826eff`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:07.217205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ffed3d28-fe2b-4e2d-a911-3d5f30ed7c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:07.361091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 860/1711] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:07.361965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a5d62-5cb2-489f-a90b-99961fccfb64 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:07.394889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 852/1712] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:07.394889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed3d28-fe2b-4e2d-a911-3d5f30ed7c2f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:07.402299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a5d62-5cb2-489f-a90b-99961fccfb64 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:07.412052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed3d28-fe2b-4e2d-a911-3d5f30ed7c2f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:07.428021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.429006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.429399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.429781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.430947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:07.431273 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.433282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.437209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.438680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.441984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.441984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.445004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.452523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.472614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 853/1713] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:07.475726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:07.504893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbcac5-cc56-41fc-944e-5799cfa96f12 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:07.517565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.518733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.519031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.523099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.523099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.523099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.535692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 854/1714] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:07.539681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:07.551509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3330db6-5f76-4a69-8c24-1d157c8c33a1 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:07.559073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.559862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.560297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.561214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.561993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.564193 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.600830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:07.639875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 861/1715] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:07 2022] POST /identity/v3/projects => generated 363 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:07.641006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:07.717847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 855/1716] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:07 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:07.718819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:07.771863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271700a4-0b7f-4052-9db6-8172b6313400 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:07.829541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ebb878-ca5a-4347-873d-5f8814f7c885 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:07.835439 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.837358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.837988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.838460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] PATH_INFO: `/v3/projects/789ee07e186d4524b4469513cdec07a8/users/60d993792d3240ad8ba2f50ffc8e3008/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.866343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=789ee07e186d4524b4469513cdec07a8, user_id=60d993792d3240ad8ba2f50ffc8e3008, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.872341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.924801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:07.925597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:07.927962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:07.928348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:07.929252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:07.932774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:07.946202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 856/1717] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:07 2022] PUT /identity/v3/projects/789ee07e186d4524b4469513cdec07a8/users/60d993792d3240ad8ba2f50ffc8e3008/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:07.951669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.034619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987de7f-b5c4-433a-835e-00b6a2d303c2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.042839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.043613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.044167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.045487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.046492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.048614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.082125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 862/1718] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:07 2022] POST /identity/v3/projects => generated 375 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:08.083489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.179114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0208224-62aa-47d6-bc2c-c21eab552b57 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.188056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.189281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.189586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.190021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.190740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.193788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 857/1719] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:07 2022] POST /identity/v3/users => generated 282 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:08.193988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.194786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.215550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8541-c785-4ea0-9dda-156a3d38a6fd admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.224090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a679e4f-8b0e-4bea-94ad-8dacf4c80337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.224869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679e4f-8b0e-4bea-94ad-8dacf4c80337 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.225360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679e4f-8b0e-4bea-94ad-8dacf4c80337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.225705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679e4f-8b0e-4bea-94ad-8dacf4c80337 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.226435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a679e4f-8b0e-4bea-94ad-8dacf4c80337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.229486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a679e4f-8b0e-4bea-94ad-8dacf4c80337 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.252607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 858/1720] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:08.254781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7cde5-320d-441d-94ec-a3618cf445eb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.255160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7cde5-320d-441d-94ec-a3618cf445eb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.256917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f7cde5-320d-441d-94ec-a3618cf445eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.297468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 863/1721] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:08 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:08.298589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.299983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-96f7cde5-320d-441d-94ec-a3618cf445eb None None] MFA Rules not processed for user `4dd10f5fa400450fb64360391a871bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:08.301440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-96f7cde5-320d-441d-94ec-a3618cf445eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:08.331467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027aab3-b19e-4f02-9762-b6474d4f7469 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.337381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.339455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.340230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.340554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.341269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.344635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.438368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 859/1722] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:08.439377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7cde5-320d-441d-94ec-a3618cf445eb None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.462859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 864/1723] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:08 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:08.463912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.483222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f7cde5-320d-441d-94ec-a3618cf445eb None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.494307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.495088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.496557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.496864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.497615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.512866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.518608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5567e2f-3406-4ca8-9d21-da40b98ebff5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.522646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 860/1724] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:08.523540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.535804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89cb9d9-123d-4a2e-a89d-9c836bc0faa3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.545357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.546183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.546476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.546691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.546805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.547541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.547644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.547892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.548172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] PATH_INFO: `/v3/projects/789ee07e186d4524b4469513cdec07a8/users/60d993792d3240ad8ba2f50ffc8e3008/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.549461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.552239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=789ee07e186d4524b4469513cdec07a8, user_id=60d993792d3240ad8ba2f50ffc8e3008, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.556698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.575983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 861/1725] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:08.578612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.582868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 865/1726] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:08 2022] PUT /identity/v3/projects/789ee07e186d4524b4469513cdec07a8/users/60d993792d3240ad8ba2f50ffc8e3008/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:08.583846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.596606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eca390-a553-47d0-b7a2-f608fece7772 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.709908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98862fe-bebf-4048-b07e-7761d18bf3ab admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.717827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.718164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.719025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.719406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.720862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.725719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.744790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4dffe-ed3d-4c55-b717-821d8914a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.745475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4dffe-ed3d-4c55-b717-821d8914a12a admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.745768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4dffe-ed3d-4c55-b717-821d8914a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.746052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4dffe-ed3d-4c55-b717-821d8914a12a admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.747321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4dffe-ed3d-4c55-b717-821d8914a12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.749171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4dffe-ed3d-4c55-b717-821d8914a12a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.758629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 866/1727] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:08.758629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.765200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 862/1728] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:08.769803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26707d-86cd-4eee-a4d2-0a710f9ec7c6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.770226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26707d-86cd-4eee-a4d2-0a710f9ec7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.770520 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26707d-86cd-4eee-a4d2-0a710f9ec7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.783549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf64e67-fde2-46d8-91c3-f5cb27f12fed admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.788741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.789520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.789872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.790217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.790989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.802512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.806020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 867/1729] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:08.806950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:08.813493 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-dc26707d-86cd-4eee-a4d2-0a710f9ec7c6 None None] MFA Rules not processed for user `60d993792d3240ad8ba2f50ffc8e3008`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:08.814815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-dc26707d-86cd-4eee-a4d2-0a710f9ec7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:08.834268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f258e-6799-41b3-8c43-8974324e66b1 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:08.868912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:08.870007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:08.870309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:08.870799 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] PATH_INFO: `/v3/projects/73bd702f7b92452fa728414617551ffa/users/5a268b7d9bbf484fbbafbe104f9761b7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:08.903173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bd702f7b92452fa728414617551ffa, user_id=5a268b7d9bbf484fbbafbe104f9761b7, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:08.907610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:08.910919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:08.995732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 863/1730] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:08.998243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26707d-86cd-4eee-a4d2-0a710f9ec7c6 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:09.012021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26707d-86cd-4eee-a4d2-0a710f9ec7c6 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:09.027593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:09.027906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:09.040761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:09.040761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:09.040761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:09.040761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:09.067725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 864/1731] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:09.067725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:09.090410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ba1cf-2cfd-4eed-b421-3ea3e8018a4e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:09.102037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:09.103489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:09.103489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:09.103489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] PATH_INFO: `/v3/projects/73ec5bdbca164b6db7fc0fdba0014a59/users/fb5c432e318a4edbba8260870cb9a144/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:09.131210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 868/1732] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:08 2022] PUT /identity/v3/projects/73bd702f7b92452fa728414617551ffa/users/5a268b7d9bbf484fbbafbe104f9761b7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:09.131982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:09.143754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:09.175283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ec5bdbca164b6db7fc0fdba0014a59, user_id=fb5c432e318a4edbba8260870cb9a144, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:09.178586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:09.283324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d215ae-253c-420c-b81f-feb9412a8237 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:09.286849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28227ad0-3d96-4464-afd5-3c570e9e0291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:09.287508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28227ad0-3d96-4464-afd5-3c570e9e0291 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:09.287848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28227ad0-3d96-4464-afd5-3c570e9e0291 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:09.288137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28227ad0-3d96-4464-afd5-3c570e9e0291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:09.314628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 865/1733] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:09 2022] PUT /identity/v3/projects/73ec5bdbca164b6db7fc0fdba0014a59/users/fb5c432e318a4edbba8260870cb9a144/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:09.317876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:09.337165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:09.437300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28227ad0-3d96-4464-afd5-3c570e9e0291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:09.445439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28227ad0-3d96-4464-afd5-3c570e9e0291 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:09.506834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 869/1734] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:09.508446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa5a11-d7db-4f29-aa93-d156684c728a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:09.508746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa5a11-d7db-4f29-aa93-d156684c728a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:09.516124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa5a11-d7db-4f29-aa93-d156684c728a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:09.561672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-82aa5a11-d7db-4f29-aa93-d156684c728a None None] MFA Rules not processed for user `5a268b7d9bbf484fbbafbe104f9761b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:09.566347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-82aa5a11-d7db-4f29-aa93-d156684c728a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:09.581148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222c7d79-11a9-4397-986f-7f77ff6b9a13 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:09.603575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:09.605710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:09.606630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:09.609274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] PATH_INFO: `/v3/projects/50b6aab73ea648b7870ac4bb1d6d079e/users/d1ae0b87306f4ed28a9460218c9058b4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:09.653499 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=50b6aab73ea648b7870ac4bb1d6d079e, user_id=d1ae0b87306f4ed28a9460218c9058b4, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:09.668332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:09.761028 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 870/1735] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:09.762839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9386d8e-0d55-4882-b485-f39190957f1c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:09.763111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9386d8e-0d55-4882-b485-f39190957f1c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:09.765182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9386d8e-0d55-4882-b485-f39190957f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:09.800480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e9386d8e-0d55-4882-b485-f39190957f1c None None] MFA Rules not processed for user `fb5c432e318a4edbba8260870cb9a144`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:09.801713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e9386d8e-0d55-4882-b485-f39190957f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:09.843242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 866/1736] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:09 2022] PUT /identity/v3/projects/50b6aab73ea648b7870ac4bb1d6d079e/users/d1ae0b87306f4ed28a9460218c9058b4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:09.846304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:10.018065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9456ffe-b3eb-44e7-9175-546a45df2caa admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:10.025421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 871/1737] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:10.029578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:10.029845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6952e2f-b8dd-4acf-b4e4-33183f784b3a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:10.029845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6952e2f-b8dd-4acf-b4e4-33183f784b3a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:10.030299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:10.030585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6952e2f-b8dd-4acf-b4e4-33183f784b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:10.030665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:10.030665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:10.030665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:10.032694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:10.056571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c6952e2f-b8dd-4acf-b4e4-33183f784b3a None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:10.058431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c6952e2f-b8dd-4acf-b4e4-33183f784b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:10.144767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 872/1738] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:10.146417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4cb24-35f3-4b70-9484-05ee37cf7360 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:10.146810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4cb24-35f3-4b70-9484-05ee37cf7360 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:10.147201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4cb24-35f3-4b70-9484-05ee37cf7360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:10.181730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-aff4cb24-35f3-4b70-9484-05ee37cf7360 None None] MFA Rules not processed for user `d1ae0b87306f4ed28a9460218c9058b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:10.183176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-aff4cb24-35f3-4b70-9484-05ee37cf7360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:10.224848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 867/1739] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:09 2022] POST /identity/v3/projects => generated 365 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:10.225942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:10.318062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 873/1740] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:10.323042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4cb24-35f3-4b70-9484-05ee37cf7360 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:10.343688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c42807-e3db-4aec-9d01-bc14906fa6ba admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:10.348196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:10.349166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:10.349652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:10.350007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:10.352889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:10.356453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4cb24-35f3-4b70-9484-05ee37cf7360 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:10.435932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:10.437648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:10.472735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 868/1741] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:10.474267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:10.507696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:10.508432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:10.508707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:10.510206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:10.511938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:10.520770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:10.599974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7816d-fa8f-4607-8373-9e357c7118b5 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:10.610985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:10.610985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:10.610985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:10.610985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:10.611511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:10.612616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:10.681166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 874/1742] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:10 2022] POST /identity/v3/projects => generated 387 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:10.683388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:10.687873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:10.764706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 869/1743] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:10 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:10.765868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:10.778182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:10.847505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ca411-af86-4385-b66f-4b0c7ef7c90e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:10.856464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:10.859795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:10.860257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:10.860870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:10.953075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:10.988426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc070b39-8892-4e81-b8c5-a94378adcb46 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:10.990568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:10.993159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.017276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 875/1744] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:11.018241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:11.048268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:11.191240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.191929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.192224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.196341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.207600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b6efd-3f6e-4e26-a6b6-4065510edf5d service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:11.213597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.215237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.215237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.215237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.216025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.220286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.331621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.334208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.346336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 876/1745] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:11 2022] POST /identity/v3/users => generated 300 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:11.346336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:11.347153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 870/1746] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:54:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:54:11.365792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:11.367345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4cc2b-58dd-4cfd-97fa-e2532e32bbdb admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:11.373804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5268b42-ab21-42ca-8a36-55214e3ecab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.374571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268b42-ab21-42ca-8a36-55214e3ecab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.375046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268b42-ab21-42ca-8a36-55214e3ecab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.375154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adee495d-4f3c-4d55-923b-56ed7a104ab1 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:11.375391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5268b42-ab21-42ca-8a36-55214e3ecab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.376857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268b42-ab21-42ca-8a36-55214e3ecab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.378568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5268b42-ab21-42ca-8a36-55214e3ecab7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.393226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.394476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.394476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.394712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.395319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.397460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.412341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 877/1747] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:11.414148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f03da-c60d-4cc1-bb15-5849eee50004 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.420242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f03da-c60d-4cc1-bb15-5849eee50004 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.420875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f03da-c60d-4cc1-bb15-5849eee50004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.446492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 871/1748] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:11.446492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:11.483689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160912b-82f5-452b-96f8-bef7676ff632 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:11.499830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.500777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.501069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.501350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] PATH_INFO: `/v3/projects/74990420de704d748636f3ea6f5cbe55/users/26ee0c9fe11641159186e9dbb8886e61/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.506582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4c8f03da-c60d-4cc1-bb15-5849eee50004 None None] MFA Rules not processed for user `d7b2b76c46b640c0b19b46ed50d333ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:11.507865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4c8f03da-c60d-4cc1-bb15-5849eee50004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:11.549122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74990420de704d748636f3ea6f5cbe55, user_id=26ee0c9fe11641159186e9dbb8886e61, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.552333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.648440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 878/1749] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jun 2 13:54:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:11.651806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f03da-c60d-4cc1-bb15-5849eee50004 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:11.677237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:11.679215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 872/1750] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:11 2022] PUT /identity/v3/projects/74990420de704d748636f3ea6f5cbe55/users/26ee0c9fe11641159186e9dbb8886e61/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:11.683481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:11.700830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f03da-c60d-4cc1-bb15-5849eee50004 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:11.856635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:11.867536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e6aa-38b7-49e4-96e3-5d24643ee1f6 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:11.874563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.875738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.876256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.876860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.877238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.878819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.880165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.880525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.880818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] PATH_INFO: `/v3/projects/96718b9612d04a4c9bdaa9e49fcc1c46/users/433f74a8d0294710b2537f02a095befa/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.885680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.896962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 873/1751] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:11.896962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:11.899687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:11.908494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96718b9612d04a4c9bdaa9e49fcc1c46, user_id=433f74a8d0294710b2537f02a095befa, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.912335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:11.934741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df7c7-0d3b-41d8-b056-1266492f56e4 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:11.940944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:11.948800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:11.949477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:11.949861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] PATH_INFO: `/v3/users/9332c692614b4b0481daf32906128bc8` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:11.956595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9332c692614b4b0481daf32906128bc8)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:11.958863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:12.047403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 879/1752] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:11 2022] PUT /identity/v3/projects/96718b9612d04a4c9bdaa9e49fcc1c46/users/433f74a8d0294710b2537f02a095befa/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:12.050080 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:12.239625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab053d8-2a7c-40d8-9cd9-939e9bd3a8e6 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:12.274674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:12.276965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:12.279614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:12.280835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] PATH_INFO: `/v3/users/d1ae0b87306f4ed28a9460218c9058b4` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:12.285723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ae0b87306f4ed28a9460218c9058b4)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:12.293646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9332c692614b4b0481daf32906128bc8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:12.294560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:12.896839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9332c692614b4b0481daf32906128bc8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:12.913467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9332c692614b4b0481daf32906128bc8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:12.929847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9332c692614b4b0481daf32906128bc8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:12.931226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9332c692614b4b0481daf32906128bc8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:12.942713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 874/1753] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:11 2022] DELETE /identity/v3/users/9332c692614b4b0481daf32906128bc8 => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:12.942713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:12.942713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.082085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:13.085796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ae0b87306f4ed28a9460218c9058b4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:13.085938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be72a49-9277-40de-b1c1-00dde585af47 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:13.091834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:13.093331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.093996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.094590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] PATH_INFO: `/v3/projects/74990420de704d748636f3ea6f5cbe55/users/26ee0c9fe11641159186e9dbb8886e61/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.100545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74990420de704d748636f3ea6f5cbe55, user_id=26ee0c9fe11641159186e9dbb8886e61, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:13.105228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:13.131311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 875/1754] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:12 2022] PUT /identity/v3/projects/74990420de704d748636f3ea6f5cbe55/users/26ee0c9fe11641159186e9dbb8886e61/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:13.132681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:13.145696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.170153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ae0b87306f4ed28a9460218c9058b4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:13.193694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ae0b87306f4ed28a9460218c9058b4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:13.203651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ae0b87306f4ed28a9460218c9058b4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:13.204692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ae0b87306f4ed28a9460218c9058b4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:13.217657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 880/1755] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:12 2022] DELETE /identity/v3/users/d1ae0b87306f4ed28a9460218c9058b4 => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:13.218728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:13.221883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.274138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb5a88-d298-4714-9c30-4c116d998151 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:13.349055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9058-b918-45b3-994e-47b9f0517b83 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:13.352817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3908c-05f7-42cf-82a6-a7fcd0bd191f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:13.353482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3908c-05f7-42cf-82a6-a7fcd0bd191f service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.353971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3908c-05f7-42cf-82a6-a7fcd0bd191f service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.354415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3908c-05f7-42cf-82a6-a7fcd0bd191f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.356764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-82c3908c-05f7-42cf-82a6-a7fcd0bd191f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.366895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3908c-05f7-42cf-82a6-a7fcd0bd191f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:13.368509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3908c-05f7-42cf-82a6-a7fcd0bd191f service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:13.395614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 881/1756] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:13.397065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c036f-f3ce-48ba-ae38-896cc4cc7100 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.397443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c036f-f3ce-48ba-ae38-896cc4cc7100 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.397728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c036f-f3ce-48ba-ae38-896cc4cc7100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.452599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-525c036f-f3ce-48ba-ae38-896cc4cc7100 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:13.457896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-525c036f-f3ce-48ba-ae38-896cc4cc7100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.466142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c9ef5-4e5b-407c-a6f4-0da2147165d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:13.468435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9ef5-4e5b-407c-a6f4-0da2147165d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.469826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9ef5-4e5b-407c-a6f4-0da2147165d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.470147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c9ef5-4e5b-407c-a6f4-0da2147165d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.470913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c9ef5-4e5b-407c-a6f4-0da2147165d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:13.477117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c9ef5-4e5b-407c-a6f4-0da2147165d3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:13.479472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 882/1757] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:13.487688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea98b58-35fd-41dc-ab33-473b7c18a8c6 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.487688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea98b58-35fd-41dc-ab33-473b7c18a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.487688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea98b58-35fd-41dc-ab33-473b7c18a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.512633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 876/1758] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:13.515168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.515622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.515800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.541113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:13.546510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:13.548676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.562826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-eea98b58-35fd-41dc-ab33-473b7c18a8c6 None None] MFA Rules not processed for user `26ee0c9fe11641159186e9dbb8886e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:13.565017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-eea98b58-35fd-41dc-ab33-473b7c18a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.603460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 877/1759] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:13.615058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:13.621854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.678474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfd81e-ec09-48a3-9a4f-fcce01dfb824 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:13.697897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:13.698809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.699547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.700019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.709834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 883/1760] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:13.719485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea98b58-35fd-41dc-ab33-473b7c18a8c6 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:13.727213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea98b58-35fd-41dc-ab33-473b7c18a8c6 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:13.728304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:13.730161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:13.739467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:13.743047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.743047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.743047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.752319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:13.773947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:13.791233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 884/1761] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:13.791953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 878/1762] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:13.793679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:13.796183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.796436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:13.810250 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc076a-77cd-4f45-ba61-5f291b8159f1 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:13.815935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:13.817480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.817891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.818288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] PATH_INFO: `/v3/projects/96718b9612d04a4c9bdaa9e49fcc1c46/users/433f74a8d0294710b2537f02a095befa/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.818543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2c14b-1eca-4bbc-83c9-0946d7875635 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:13.821351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96718b9612d04a4c9bdaa9e49fcc1c46, user_id=433f74a8d0294710b2537f02a095befa, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:13.826124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:13.829745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be9d9c-9c99-4d55-b5fb-48a2914dd0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:13.834970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be9d9c-9c99-4d55-b5fb-48a2914dd0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.834970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be9d9c-9c99-4d55-b5fb-48a2914dd0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.834970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be9d9c-9c99-4d55-b5fb-48a2914dd0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.854993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 885/1763] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:13 2022] PUT /identity/v3/projects/96718b9612d04a4c9bdaa9e49fcc1c46/users/433f74a8d0294710b2537f02a095befa/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:13.856598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:13.859271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.875228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be9d9c-9c99-4d55-b5fb-48a2914dd0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:13.875453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be9d9c-9c99-4d55-b5fb-48a2914dd0c6 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:13.894941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 879/1764] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:13.898788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:13.900335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:13.901150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:13.946305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] MFA Rules not processed for user `433f74a8d0294710b2537f02a095befa`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:13.947789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:13.975633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:14.052836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052497d7-e15d-4e24-8bf0-8bacbaac907a admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:14.061978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:14.062844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:14.063328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:14.063616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:14.078008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 880/1765] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:14.092049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:14.098827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:14.134983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663074b8-b19d-4a25-871e-6c78d75f6c0a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:14.147860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:14.147860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:14.150060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:14.151886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:14.168860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:14.171681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:14.198953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 881/1766] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:14.250451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:14.253489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:14.287443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 886/1767] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:14.549297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:14.566978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcab107-a49d-41ce-9fb7-1b143caf3b4a service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:14.571690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76bf07-76e5-49e1-8f95-f8cc7b5194de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:14.572333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bf07-76e5-49e1-8f95-f8cc7b5194de service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:14.572784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bf07-76e5-49e1-8f95-f8cc7b5194de service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:14.573073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76bf07-76e5-49e1-8f95-f8cc7b5194de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:14.576211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0c76bf07-76e5-49e1-8f95-f8cc7b5194de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:14.675474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:14.684509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76bf07-76e5-49e1-8f95-f8cc7b5194de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:14.684509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76bf07-76e5-49e1-8f95-f8cc7b5194de service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:14.708484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 882/1768] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:14.842809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:14.844634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:15.112773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bda9b-b4ef-42d3-a6d2-da55a5a7560b service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:15.131461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:15.133507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:15.134593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:15.134912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] PATH_INFO: `/v3/projects/7a8f1ae070cc48b8beb4762431c88e01` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:15.140166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8f1ae070cc48b8beb4762431c88e01)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:15.150869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:15.445331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8f1ae070cc48b8beb4762431c88e01', 'request_id': 'req-7c351b7f-7eb4-4689-a43d-eddbda9c3039'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:15.455194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8f1ae070cc48b8beb4762431c88e01', 'request_id': 'req-7c351b7f-7eb4-4689-a43d-eddbda9c3039'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:15.535160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8f1ae070cc48b8beb4762431c88e01', 'request_id': 'req-7c351b7f-7eb4-4689-a43d-eddbda9c3039'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:15.578086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] The token cache is being invalidate because project 7a8f1ae070cc48b8beb4762431c88e01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:15.581263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:15.583187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:15.592972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 887/1769] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:14 2022] DELETE /identity/v3/projects/7a8f1ae070cc48b8beb4762431c88e01 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:15.594821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ad12-0191-46ca-a4fb-0550903dfa7a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:15.595321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ad12-0191-46ca-a4fb-0550903dfa7a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:15.598192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0ad12-0191-46ca-a4fb-0550903dfa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:15.616834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-80a0ad12-0191-46ca-a4fb-0550903dfa7a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:15.618390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-80a0ad12-0191-46ca-a4fb-0550903dfa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:15.736646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:15.738392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:15.793985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 883/1770] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:15.820775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b52e2-4df4-4759-adf7-3f47da8e57eb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:15.821395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b52e2-4df4-4759-adf7-3f47da8e57eb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:15.822080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b52e2-4df4-4759-adf7-3f47da8e57eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:15.898150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-705b52e2-4df4-4759-adf7-3f47da8e57eb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:15.900634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-705b52e2-4df4-4759-adf7-3f47da8e57eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:15.922355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 884/1771] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:15.928354 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b52e2-4df4-4759-adf7-3f47da8e57eb None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:15.943596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351b7f-7eb4-4689-a43d-eddbda9c3039 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:15.948933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b52e2-4df4-4759-adf7-3f47da8e57eb None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:15.951482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:15.952999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:15.953516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:15.954010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] PATH_INFO: `/v3/projects/50b6aab73ea648b7870ac4bb1d6d079e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:15.956841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50b6aab73ea648b7870ac4bb1d6d079e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:15.960644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:15.988199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:15.993255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:15.993255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:15.993255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:15.995697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:15.996213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:16.001684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:16.082097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 885/1772] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:16.084525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:16.115446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50b6aab73ea648b7870ac4bb1d6d079e', 'request_id': 'req-7e9a1d91-402f-41d5-9708-243631515691'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:16.128657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61243031-2652-4611-8baa-1d439ece3b5a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:16.133102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50b6aab73ea648b7870ac4bb1d6d079e', 'request_id': 'req-7e9a1d91-402f-41d5-9708-243631515691'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:16.183871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:16.207053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50b6aab73ea648b7870ac4bb1d6d079e', 'request_id': 'req-7e9a1d91-402f-41d5-9708-243631515691'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:16.241019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:16.261133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] The token cache is being invalidate because project 50b6aab73ea648b7870ac4bb1d6d079e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:16.264288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:16.266981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7e9a1d91-402f-41d5-9708-243631515691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:16.285265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 888/1773] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:15 2022] DELETE /identity/v3/projects/50b6aab73ea648b7870ac4bb1d6d079e => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:16.292224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a3a79-accb-4261-b886-0aa429e82dfb None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.292890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a3a79-accb-4261-b886-0aa429e82dfb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.296152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a3a79-accb-4261-b886-0aa429e82dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.313935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:16.314408 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.315331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.315717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.316599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:16.319316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:16.358856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-773a3a79-accb-4261-b886-0aa429e82dfb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:16.361070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-773a3a79-accb-4261-b886-0aa429e82dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:16.401623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 889/1774] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:16.421273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac03c-e511-4fa0-a66b-df7c8e76e8bc None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.426241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac03c-e511-4fa0-a66b-df7c8e76e8bc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.426241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac03c-e511-4fa0-a66b-df7c8e76e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.501321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 886/1775] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:16 2022] POST /identity/v3/projects => generated 385 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:16.502398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:16.502530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-51cac03c-e511-4fa0-a66b-df7c8e76e8bc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:16.503719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-51cac03c-e511-4fa0-a66b-df7c8e76e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:16.511815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:16.760086 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaadd01-ee43-452a-90ee-53a3fb89e186 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:16.770343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:16.771160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.771720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.773760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.778438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:16.779972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 890/1776] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:16.784450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f07b-8991-4276-93e4-c4123bfc3f5c None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.784450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f07b-8991-4276-93e4-c4123bfc3f5c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.784450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786f07b-8991-4276-93e4-c4123bfc3f5c None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.784847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:16.792098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 891/1777] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:54:16 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:16.793849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e65458-79ac-49e5-9384-e98898feeec9 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.797058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e65458-79ac-49e5-9384-e98898feeec9 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.797478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e65458-79ac-49e5-9384-e98898feeec9 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.799471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 892/1778] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:54:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:16.801110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e65458-79ac-49e5-9384-e98898feeec9 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:16.805543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-74e65458-79ac-49e5-9384-e98898feeec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:16.891562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e65458-79ac-49e5-9384-e98898feeec9 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:16.902816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 887/1779] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:16 2022] POST /identity/v3/users => generated 293 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:16.908326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:16.908326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.908326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.908326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.908788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:16.908882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:16.919533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03665366-a6c0-4602-aede-a6411530cbf8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:16.926476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f55e9-dc2c-4660-936f-b2f783459a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:16.927501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f55e9-dc2c-4660-936f-b2f783459a10 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.932527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f55e9-dc2c-4660-936f-b2f783459a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.932527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f55e9-dc2c-4660-936f-b2f783459a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.932527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f55e9-dc2c-4660-936f-b2f783459a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:16.932527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f55e9-dc2c-4660-936f-b2f783459a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:16.932527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f55e9-dc2c-4660-936f-b2f783459a10 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:16.954528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 888/1780] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:16.956324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7ad3-1bb6-48eb-83b5-5149d51563f0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:16.961289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7ad3-1bb6-48eb-83b5-5149d51563f0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:16.961289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd7ad3-1bb6-48eb-83b5-5149d51563f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:16.978912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-62cd7ad3-1bb6-48eb-83b5-5149d51563f0 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:16.980262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-62cd7ad3-1bb6-48eb-83b5-5149d51563f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:17.076710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.083130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.085967 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 889/1781] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:54:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:17.087818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.088507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.088968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.094688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 893/1782] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:17.095907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.109748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780c337-faf6-4741-84e9-a690cde21a89 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.115335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.116014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.116336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.116666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.117398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.118983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:17.119130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.120491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:17.135514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 894/1783] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:17.135514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.141409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 890/1784] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:17.142431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.144389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:17.146090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e90ad2-e086-430f-b13e-0d4295cf4182 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.151429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.152734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.152734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.152905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.153625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.165072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60415474-4b64-48f9-8864-dc54dcc10c29 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.168872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.171864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.172790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.173267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.173720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.188081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:17.189685 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.195352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.211249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 891/1785] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:17.212431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.230687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc1579-1dd7-48c1-a5a6-7e00547a5c34 service nova] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.257803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.258538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.258833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.259121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.264336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:17.267707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.269476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.301418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 892/1786] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:17.302874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.313527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 895/1787] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:17 2022] POST /identity/v3/projects => generated 403 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:17.315092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d105bf5-0797-41f7-a23e-b9105723e19f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.320492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.434838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.437164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.437458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.437744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] PATH_INFO: `/v3/projects/6e0e07e9f26b4673997922ab0fb03e90/users/c5c89c2dcb5240809df0b8a3f9792e97/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.461041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0e07e9f26b4673997922ab0fb03e90, user_id=c5c89c2dcb5240809df0b8a3f9792e97, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.462406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d7b60-fc3d-4001-a4d1-860679988a31 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.463720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.468605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faa8bb-f01f-48f8-a6a2-c80d4413205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.469475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faa8bb-f01f-48f8-a6a2-c80d4413205d admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.469875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faa8bb-f01f-48f8-a6a2-c80d4413205d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.470247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faa8bb-f01f-48f8-a6a2-c80d4413205d admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.471303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1faa8bb-f01f-48f8-a6a2-c80d4413205d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.473394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1faa8bb-f01f-48f8-a6a2-c80d4413205d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.572172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 893/1788] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:17 2022] PUT /identity/v3/projects/6e0e07e9f26b4673997922ab0fb03e90/users/c5c89c2dcb5240809df0b8a3f9792e97/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:17.573374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.575588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:17.579574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 896/1789] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:17 2022] POST /identity/v3/users => generated 302 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:17.590122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a822bf-d7fe-49b3-bdf4-0893aab14e44 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.590431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a822bf-d7fe-49b3-bdf4-0893aab14e44 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.590835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a822bf-d7fe-49b3-bdf4-0893aab14e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.623981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a0a822bf-d7fe-49b3-bdf4-0893aab14e44 None None] MFA Rules not processed for user `c5c89c2dcb5240809df0b8a3f9792e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:17.625379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a0a822bf-d7fe-49b3-bdf4-0893aab14e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:17.712827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c742b2-f62a-4418-9d60-f2785ca48bf0 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.732917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 897/1790] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:17.733300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.734091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.734436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.734740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a822bf-d7fe-49b3-bdf4-0893aab14e44 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.734853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.756460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.759237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.786290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 894/1791] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:17.787952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.815758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a822bf-d7fe-49b3-bdf4-0893aab14e44 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.824027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.825101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.825340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.825619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.826938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.829049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.852715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:17.855053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 898/1792] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:17.856961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.886678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f5240-39a7-4a94-a38a-ebb2e8ee155c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.892585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.893199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.893482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.893757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.894486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.896742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.921361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 899/1793] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:17.923024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:17.935890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dec2f0-e537-4338-b4f5-e0f33d85d6cb service nova] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.953839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.954540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.954885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.955172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.955980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.957482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3d579d-f823-4ec3-9532-8657d453e022 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:17.958110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:17.963819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053de683-a269-490d-9c39-7df88e366440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:17.969325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de683-a269-490d-9c39-7df88e366440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:17.969325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de683-a269-490d-9c39-7df88e366440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:17.969325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053de683-a269-490d-9c39-7df88e366440 admin admin] PATH_INFO: `/v3/projects/13b4029c23f54a199fc20e0cf4ba5e0a/users/d93132b106904fed89857bfca10c8c9a/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:17.985779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053de683-a269-490d-9c39-7df88e366440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b4029c23f54a199fc20e0cf4ba5e0a, user_id=d93132b106904fed89857bfca10c8c9a, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:17.994998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053de683-a269-490d-9c39-7df88e366440 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.084934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 895/1794] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:17 2022] POST /identity/v3/projects => generated 387 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:18.087673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:18.110038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 900/1795] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:17 2022] PUT /identity/v3/projects/13b4029c23f54a199fc20e0cf4ba5e0a/users/d93132b106904fed89857bfca10c8c9a/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:18.117092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.117456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.117836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.146385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:18.148679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:18.195103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfeb25f-6fd0-40e6-bb01-8c230066ec34 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:18.236382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 901/1796] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:18.246168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:18.247498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:18.255945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:18.256662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.256949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.257225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.257954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:18.259863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.306350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c78e15-7bad-44e1-9aaf-135f233f10da None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:18.309987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:18.311275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.311560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.311842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.321243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:18.322736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.333267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 902/1797] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:18.335817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:18.369559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 896/1798] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:18 2022] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:18.373870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:18.383591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbc8bc-c675-41b5-929d-b2a67cef0fa3 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:18.391061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:18.391743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.392024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.392720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.393173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:18.394986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.412730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 903/1799] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:18.420901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:18.437122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41391cb-65ae-49d8-b26b-214804d15154 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:18.442592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:18.444422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.444830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.450681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] PATH_INFO: `/v3/projects/15a4e01e4d0e4067bcc533f6664037e2/users/c1088c627f3b4ef18341a8948f0a0d56/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.462827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a4e01e4d0e4067bcc533f6664037e2, user_id=c1088c627f3b4ef18341a8948f0a0d56, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:18.465549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.538892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 897/1800] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:18 2022] PUT /identity/v3/projects/15a4e01e4d0e4067bcc533f6664037e2/users/c1088c627f3b4ef18341a8948f0a0d56/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:18.542629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:18.553421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d217-9df5-4b29-91d8-3b7df1f0486b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:18.613029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac8cf-0a9a-4df1-b35c-5d7bc7e8ad21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:18.613692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac8cf-0a9a-4df1-b35c-5d7bc7e8ad21 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.613988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac8cf-0a9a-4df1-b35c-5d7bc7e8ad21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.614300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac8cf-0a9a-4df1-b35c-5d7bc7e8ad21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.615036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac8cf-0a9a-4df1-b35c-5d7bc7e8ad21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:18.616681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ac8cf-0a9a-4df1-b35c-5d7bc7e8ad21 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.628783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 904/1801] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:18.633338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:18.644993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ce646-dac9-4f2d-a57c-ab7bbb863c25 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:18.650727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:18.651576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.651930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.652278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] PATH_INFO: `/v3/projects/15a4e01e4d0e4067bcc533f6664037e2/users/c1088c627f3b4ef18341a8948f0a0d56/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.654441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a4e01e4d0e4067bcc533f6664037e2, user_id=c1088c627f3b4ef18341a8948f0a0d56, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:18.657199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.667736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 898/1802] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:18 2022] PUT /identity/v3/projects/15a4e01e4d0e4067bcc533f6664037e2/users/c1088c627f3b4ef18341a8948f0a0d56/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:18.682560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0d73-ab0f-4e7f-82e7-d75e4e668af6 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.682857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0d73-ab0f-4e7f-82e7-d75e4e668af6 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.683143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e0d73-ab0f-4e7f-82e7-d75e4e668af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.713434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-637e0d73-ab0f-4e7f-82e7-d75e4e668af6 None None] MFA Rules not processed for user `c1088c627f3b4ef18341a8948f0a0d56`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:18.714699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-637e0d73-ab0f-4e7f-82e7-d75e4e668af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:18.786060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 905/1803] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:18.798661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:18.853999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d462b74-ffc2-4d7f-aafd-54aad0d1e493 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:18.858144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0d80d-e37d-483e-9b15-75f3e2f98705 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:18.858784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d80d-e37d-483e-9b15-75f3e2f98705 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:18.859071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d80d-e37d-483e-9b15-75f3e2f98705 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:18.859355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0d80d-e37d-483e-9b15-75f3e2f98705 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:18.869150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0d80d-e37d-483e-9b15-75f3e2f98705 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:18.871581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0d80d-e37d-483e-9b15-75f3e2f98705 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:18.878165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:18.882292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 899/1804] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:18.954208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0d73-ab0f-4e7f-82e7-d75e4e668af6 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:19.027768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e0d73-ab0f-4e7f-82e7-d75e4e668af6 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:19.038192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:19.039363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:19.040152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:19.040465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] PATH_INFO: `/v3/users/c5c89c2dcb5240809df0b8a3f9792e97` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:19.042223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c89c2dcb5240809df0b8a3f9792e97)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:19.045909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:19.283800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c89c2dcb5240809df0b8a3f9792e97'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:19.354373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c89c2dcb5240809df0b8a3f9792e97'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:19.368611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c89c2dcb5240809df0b8a3f9792e97'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:19.375730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c89c2dcb5240809df0b8a3f9792e97'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:19.376496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c89c2dcb5240809df0b8a3f9792e97'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:19.382413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 906/1805] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:18 2022] DELETE /identity/v3/users/c5c89c2dcb5240809df0b8a3f9792e97 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:19.387097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75655ddc-0c26-4c88-81e4-1f803fb1cd61 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:19.387383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75655ddc-0c26-4c88-81e4-1f803fb1cd61 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:19.387663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75655ddc-0c26-4c88-81e4-1f803fb1cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:19.406264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-75655ddc-0c26-4c88-81e4-1f803fb1cd61 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:19.407466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-75655ddc-0c26-4c88-81e4-1f803fb1cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:19.476594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 900/1806] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:19.483683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:19.492782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:19.523996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:19.551493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60a26a6-553c-4df3-bbd1-49c685182d96 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:19.555852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:19.555852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:19.556192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:19.556327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:19.566002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:19.567446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:19.577465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 907/1807] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:19.761033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7152d4-dc68-4857-ab9c-8dd310cffabc None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:19.761324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7152d4-dc68-4857-ab9c-8dd310cffabc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:19.761945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7152d4-dc68-4857-ab9c-8dd310cffabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:19.794014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6c7152d4-dc68-4857-ab9c-8dd310cffabc None None] MFA Rules not processed for user `d93132b106904fed89857bfca10c8c9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:19.795994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6c7152d4-dc68-4857-ab9c-8dd310cffabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:19.882468 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 901/1808] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:19 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:19.884623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:19.886014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:19.903159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1032bc80-19a1-488d-beff-92fd26265383 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:19.909347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:19.910019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:19.910308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:19.910589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:19.911296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:19.913442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.035244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 908/1809] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:19 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:20.038596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7152d4-dc68-4857-ab9c-8dd310cffabc None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:20.049998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7152d4-dc68-4857-ab9c-8dd310cffabc None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:20.062030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:20.069074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:20.071230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:20.121185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:20.122114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:20.124824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:20.125120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:20.125899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:20.127876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.147698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd294f-b2d0-4ebb-ac82-65be29bcbad4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:20.153707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:20.155149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:20.155533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:20.156181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] PATH_INFO: `/v3/projects/6e0e07e9f26b4673997922ab0fb03e90` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:20.157551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0e07e9f26b4673997922ab0fb03e90)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:20.159517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.276749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 902/1810] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:20 2022] POST /identity/v3/users => generated 309 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:20.280812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:20.291148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e6f5a-fac9-424c-b103-e951648d699f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:20.295776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:20.296458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:20.296747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:20.297023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:20.297777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:20.299353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.309256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 903/1811] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:20.314755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:20.327569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926123-9296-4832-b74c-94287eb685d7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:20.334268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0e07e9f26b4673997922ab0fb03e90', 'request_id': 'req-d067980d-4573-4332-b0bf-d2a9ff3477b2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.340593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0e07e9f26b4673997922ab0fb03e90', 'request_id': 'req-d067980d-4573-4332-b0bf-d2a9ff3477b2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.390708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:20.391546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:20.391835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:20.392115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] PATH_INFO: `/v3/projects/eae41c929f394e449eea9fc384b584a3/users/f886778ec88b40c3a68487c4d6f00603/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:20.414382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae41c929f394e449eea9fc384b584a3, user_id=f886778ec88b40c3a68487c4d6f00603, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:20.417251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.432934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0e07e9f26b4673997922ab0fb03e90', 'request_id': 'req-d067980d-4573-4332-b0bf-d2a9ff3477b2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.451600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] The token cache is being invalidate because project 6e0e07e9f26b4673997922ab0fb03e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:20.452177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.454979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.457717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 909/1812] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:20 2022] DELETE /identity/v3/projects/6e0e07e9f26b4673997922ab0fb03e90 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:20.458630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:20.461428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:20.474866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067980d-4573-4332-b0bf-d2a9ff3477b2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:20.480072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:20.480994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:20.481307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:20.482018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] PATH_INFO: `/v3/users/c1088c627f3b4ef18341a8948f0a0d56` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:20.482923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1088c627f3b4ef18341a8948f0a0d56)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:20.485041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.504931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 904/1813] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:20 2022] PUT /identity/v3/projects/eae41c929f394e449eea9fc384b584a3/users/f886778ec88b40c3a68487c4d6f00603/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:20.506856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:20.511587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:20.587993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd35e-d822-4601-af43-9fec615c6ef0 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:20.592810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:20.593479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:20.593771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:20.594055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:20.594786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:20.596413 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.606286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 905/1814] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:20.610176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:20.611390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:20.621529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f583a-81c7-4568-aba1-369177d76d81 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:20.627580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:20.628649 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:20.628941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:20.629222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] PATH_INFO: `/v3/projects/eae41c929f394e449eea9fc384b584a3/users/f886778ec88b40c3a68487c4d6f00603/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:20.631196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae41c929f394e449eea9fc384b584a3, user_id=f886778ec88b40c3a68487c4d6f00603, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:20.634061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:20.645695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 906/1815] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:20 2022] PUT /identity/v3/projects/eae41c929f394e449eea9fc384b584a3/users/f886778ec88b40c3a68487c4d6f00603/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:20.680687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1088c627f3b4ef18341a8948f0a0d56'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.761191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1088c627f3b4ef18341a8948f0a0d56'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.775681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1088c627f3b4ef18341a8948f0a0d56'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.782595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1088c627f3b4ef18341a8948f0a0d56'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.783320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b38526ab-a34e-4247-88c5-a56743f306a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1088c627f3b4ef18341a8948f0a0d56'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:20.789869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 910/1816] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:20 2022] DELETE /identity/v3/users/c1088c627f3b4ef18341a8948f0a0d56 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:21.308341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:21.310622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:21.382421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff01b4-471c-4ab8-b7f0-af415ab666ee admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:21.445073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:21.445933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:21.446225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:21.446512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] PATH_INFO: `/v3/projects/15a4e01e4d0e4067bcc533f6664037e2` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:21.447733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a4e01e4d0e4067bcc533f6664037e2)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:21.450077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:21.614427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a4e01e4d0e4067bcc533f6664037e2', 'request_id': 'req-94d7fac2-53f4-476c-9ab7-62874d2db219'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:21.620864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a4e01e4d0e4067bcc533f6664037e2', 'request_id': 'req-94d7fac2-53f4-476c-9ab7-62874d2db219'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:21.706235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a4e01e4d0e4067bcc533f6664037e2', 'request_id': 'req-94d7fac2-53f4-476c-9ab7-62874d2db219'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:21.719240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] The token cache is being invalidate because project 15a4e01e4d0e4067bcc533f6664037e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:21.719616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:21.720501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-94d7fac2-53f4-476c-9ab7-62874d2db219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:21.722277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 907/1817] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:21 2022] DELETE /identity/v3/projects/15a4e01e4d0e4067bcc533f6664037e2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:21.728133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e43d0f-1174-450a-a750-c93fa048f22f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:21.728700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e43d0f-1174-450a-a750-c93fa048f22f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:21.728700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e43d0f-1174-450a-a750-c93fa048f22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:21.750810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-76e43d0f-1174-450a-a750-c93fa048f22f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:21.752018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-76e43d0f-1174-450a-a750-c93fa048f22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:21.818487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 911/1818] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:21.827180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b82ef-ab30-4641-b2b8-7a1c06ca0eec None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:21.827471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b82ef-ab30-4641-b2b8-7a1c06ca0eec None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:21.827751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b82ef-ab30-4641-b2b8-7a1c06ca0eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:21.846415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5e7b82ef-ab30-4641-b2b8-7a1c06ca0eec None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:21.847617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5e7b82ef-ab30-4641-b2b8-7a1c06ca0eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:21.855873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 908/1819] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:21.863197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e43d0f-1174-450a-a750-c93fa048f22f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:21.873278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e43d0f-1174-450a-a750-c93fa048f22f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:21.878073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:21.878729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:21.879015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:21.879293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:21.880015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:21.880324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:21.881954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:21.894136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 912/1820] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:54:21.898453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b82ef-ab30-4641-b2b8-7a1c06ca0eec None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:21.908292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b82ef-ab30-4641-b2b8-7a1c06ca0eec None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:21.913707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b725c-7ecb-4b30-b934-83f80918d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:21.914398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b725c-7ecb-4b30-b934-83f80918d9fb admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:21.914682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b725c-7ecb-4b30-b934-83f80918d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:21.915104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b725c-7ecb-4b30-b934-83f80918d9fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:21.915866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b725c-7ecb-4b30-b934-83f80918d9fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:21.917796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b725c-7ecb-4b30-b934-83f80918d9fb admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:22.095722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 909/1821] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:21 2022] POST /identity/v3/projects => generated 399 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:22.097245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:22.108222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85921-31a2-4036-8ca1-1918788a3f60 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:22.175070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:22.175851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.176207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.176597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.177359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:22.179438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:22.206062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c6ad4-1c3f-41cd-a5e0-1122be03985b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.206387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c6ad4-1c3f-41cd-a5e0-1122be03985b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.206673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c6ad4-1c3f-41cd-a5e0-1122be03985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.237087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ba3c6ad4-1c3f-41cd-a5e0-1122be03985b None None] MFA Rules not processed for user `f886778ec88b40c3a68487c4d6f00603`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:22.238305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ba3c6ad4-1c3f-41cd-a5e0-1122be03985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:22.284959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 913/1822] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:22 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:22.291282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:22.301990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135e8a2-86a4-4bb4-9383-6327c7ed5a3c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:22.306822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:22.307493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.307786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.308065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.308846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:22.310835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:22.321610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 914/1823] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:22.323366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 910/1824] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:22.328053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:22.340973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e7240-a4fa-4ca2-806b-337bf9f2db69 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:22.346568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100914f1-c25a-4f4f-861f-aed451448c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:22.347236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100914f1-c25a-4f4f-861f-aed451448c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.347525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100914f1-c25a-4f4f-861f-aed451448c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.347948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100914f1-c25a-4f4f-861f-aed451448c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.348718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100914f1-c25a-4f4f-861f-aed451448c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:22.350332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100914f1-c25a-4f4f-861f-aed451448c75 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:22.361519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 915/1825] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:22.365816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c6ad4-1c3f-41cd-a5e0-1122be03985b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:22.379450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c6ad4-1c3f-41cd-a5e0-1122be03985b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:22.381345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:22.382234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.382522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.382800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] PATH_INFO: `/v3/projects/41a0ac1e5bcd468caf81039d3d2bd711/users/33b567a1b4a743179e258995a74d370a/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.399679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a0ac1e5bcd468caf81039d3d2bd711, user_id=33b567a1b4a743179e258995a74d370a, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:22.402458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:22.512322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 911/1826] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:22 2022] PUT /identity/v3/projects/41a0ac1e5bcd468caf81039d3d2bd711/users/33b567a1b4a743179e258995a74d370a/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:22.524332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35cd13-8ba8-4f77-94bf-a98f597f788c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.524701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35cd13-8ba8-4f77-94bf-a98f597f788c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.524985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35cd13-8ba8-4f77-94bf-a98f597f788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.552653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ae35cd13-8ba8-4f77-94bf-a98f597f788c None None] MFA Rules not processed for user `33b567a1b4a743179e258995a74d370a`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:22.553881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ae35cd13-8ba8-4f77-94bf-a98f597f788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:22.583185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:22.636837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 916/1827] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:22.642872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:22.657905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:22.710556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ee687-512b-490e-8924-8429a3479c41 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:22.717351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:22.718028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.718801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.718801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.719339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:22.721497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:22.808095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 912/1828] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:22 2022] POST /identity/v3/projects => generated 397 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:22.808451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35cd13-8ba8-4f77-94bf-a98f597f788c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:22.820138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35cd13-8ba8-4f77-94bf-a98f597f788c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:22.880629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491af83-95c4-496b-ba0d-f9c262631b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:22.881309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491af83-95c4-496b-ba0d-f9c262631b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.881626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491af83-95c4-496b-ba0d-f9c262631b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.881909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491af83-95c4-496b-ba0d-f9c262631b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.882674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491af83-95c4-496b-ba0d-f9c262631b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:22.884637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491af83-95c4-496b-ba0d-f9c262631b57 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:22.965478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 917/1829] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:22 2022] POST /identity/v3/users => generated 305 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:22.970582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:22.985006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2f73a-36df-4e30-a2ea-f597b47982f8 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.985347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2f73a-36df-4e30-a2ea-f597b47982f8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.985581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2f73a-36df-4e30-a2ea-f597b47982f8 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.987138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 918/1830] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 02 13:54:22.987329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3084d2ff-1c40-4c98-a37b-7ee3fd0f8ab0 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:22.993238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:22.993943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.994234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.994521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:22.995599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:22.997103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:22.997395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:22.997783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:23.004477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:23.023687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:23.023687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:23.026116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 913/1831] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:23.027763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:23.043282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e22b2-39ee-4be5-97bc-4c3685d1a588 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:23.049511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:23.050684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:23.050981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:23.051264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] PATH_INFO: `/v3/projects/f30affc4f0074e91bc85e6d2a6fd7d15/users/a85bf9c83bed42d6b8c1c595d645334c/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:23.068387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30affc4f0074e91bc85e6d2a6fd7d15, user_id=a85bf9c83bed42d6b8c1c595d645334c, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:23.072079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:23.098589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 919/1832] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:54:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:23.109458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:23.110921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:23.127197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e417da6-4332-4a2a-82d7-2d40cba4cb87 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:23.132788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:23.133442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:23.133730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:23.134015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:23.143352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:23.145031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:23.155287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 920/1833] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:23.197917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 914/1834] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:23 2022] PUT /identity/v3/projects/f30affc4f0074e91bc85e6d2a6fd7d15/users/a85bf9c83bed42d6b8c1c595d645334c/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:23.204024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:23.217289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd993ac7-0bb6-4724-9390-08d1f7554155 service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:23.278630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c04ac-f00d-4ec7-a6ab-78e8815c0857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:23.280603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c04ac-f00d-4ec7-a6ab-78e8815c0857 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:23.281126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c04ac-f00d-4ec7-a6ab-78e8815c0857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:23.285061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c04ac-f00d-4ec7-a6ab-78e8815c0857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:23.285061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c04ac-f00d-4ec7-a6ab-78e8815c0857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:23.285061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c04ac-f00d-4ec7-a6ab-78e8815c0857 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:23.297759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 921/1835] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:23.299544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:23.310449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50f6d4-31c4-4cad-a88c-14a28bae02c3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:23.315616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:23.316559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:23.316847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:23.317129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] PATH_INFO: `/v3/projects/f30affc4f0074e91bc85e6d2a6fd7d15/users/a85bf9c83bed42d6b8c1c595d645334c/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:23.319910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30affc4f0074e91bc85e6d2a6fd7d15, user_id=a85bf9c83bed42d6b8c1c595d645334c, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:23.322743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:23.336097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 915/1836] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:23 2022] PUT /identity/v3/projects/f30affc4f0074e91bc85e6d2a6fd7d15/users/a85bf9c83bed42d6b8c1c595d645334c/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:23.347053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c1df-ddd6-474c-9141-b13787271aa0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:23.347368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c1df-ddd6-474c-9141-b13787271aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:23.347636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79c1df-ddd6-474c-9141-b13787271aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:23.376697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-da79c1df-ddd6-474c-9141-b13787271aa0 None None] MFA Rules not processed for user `a85bf9c83bed42d6b8c1c595d645334c`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:23.378126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-da79c1df-ddd6-474c-9141-b13787271aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:23.478731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 922/1837] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:23.492230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:23.494419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:23.572441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1955d57-8734-471e-b20a-b19dcf5c0274 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:23.575631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:23.576652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:23.577016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:23.577368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:23.587549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:23.589159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:23.623664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 916/1838] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:23 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:23.876701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c1df-ddd6-474c-9141-b13787271aa0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:23.891631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79c1df-ddd6-474c-9141-b13787271aa0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:23.896276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:23.897201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:23.897495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:23.897773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:24.000220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:24.001859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:24.012146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 923/1839] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:24.016231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:24.017866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:24.112870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:24.136111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100960c-7c66-4971-9912-dd94f3af17f1 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:24.149706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:24.150546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:24.150893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:24.151174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] PATH_INFO: `/v3/users/d93132b106904fed89857bfca10c8c9a` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:24.152496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d93132b106904fed89857bfca10c8c9a)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:24.154409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:24.298250 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:24.299993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:24.331203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78789ea4-2ce1-4972-a50c-730ec9ee5630 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:24.336804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:24.337941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:24.338428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:24.338908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] PATH_INFO: `/v3/users/5a268b7d9bbf484fbbafbe104f9761b7` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:24.340813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a268b7d9bbf484fbbafbe104f9761b7)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:24.345042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:24.480458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd93132b106904fed89857bfca10c8c9a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.554697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd93132b106904fed89857bfca10c8c9a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.579635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd93132b106904fed89857bfca10c8c9a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.586680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd93132b106904fed89857bfca10c8c9a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.587516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-52629d60-de56-4a43-8c80-5ee7be331e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd93132b106904fed89857bfca10c8c9a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.594437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 917/1840] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:24 2022] DELETE /identity/v3/users/d93132b106904fed89857bfca10c8c9a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:24.662530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a268b7d9bbf484fbbafbe104f9761b7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.788976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a268b7d9bbf484fbbafbe104f9761b7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.813519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a268b7d9bbf484fbbafbe104f9761b7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.823279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a268b7d9bbf484fbbafbe104f9761b7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.824096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a268b7d9bbf484fbbafbe104f9761b7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:24.840440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 924/1841] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:24 2022] DELETE /identity/v3/users/5a268b7d9bbf484fbbafbe104f9761b7 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:24.853300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:24.853660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:24.854010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:24.876629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:24.878105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:24.956576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:24.959540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:25.005868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 918/1842] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:25.010568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:25.013402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:25.068145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:25.150087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add22b90-1c4a-447b-8860-b131c0a54539 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:25.151268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40322b46-ac31-4523-a90b-dcd05cbad96b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:25.160570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:25.161261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:25.161385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:25.166769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:25.166769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:25.166979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:25.166979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:25.166979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] PATH_INFO: `/v3/projects/13b4029c23f54a199fc20e0cf4ba5e0a` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:25.166979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b4029c23f54a199fc20e0cf4ba5e0a)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:25.169137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:25.183616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:25.186348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:25.200124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 919/1843] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:25.430361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b4029c23f54a199fc20e0cf4ba5e0a', 'request_id': 'req-e7f5722e-19c8-496b-90c3-313b4acec22f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:25.446087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b4029c23f54a199fc20e0cf4ba5e0a', 'request_id': 'req-e7f5722e-19c8-496b-90c3-313b4acec22f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:25.546447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b4029c23f54a199fc20e0cf4ba5e0a', 'request_id': 'req-e7f5722e-19c8-496b-90c3-313b4acec22f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:25.574002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] The token cache is being invalidate because project 13b4029c23f54a199fc20e0cf4ba5e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:25.574824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:25.576989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:25.585698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 925/1844] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:24 2022] DELETE /identity/v3/projects/13b4029c23f54a199fc20e0cf4ba5e0a => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:25.587230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:25.601652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bfaff-7ad6-4c29-83e8-d69a5e34ce99 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:25.744872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:25.751426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:25.752687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:25.753191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:25.753592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] PATH_INFO: `/v3/users/f886778ec88b40c3a68487c4d6f00603` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:25.755279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f886778ec88b40c3a68487c4d6f00603)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:25.757874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:25.910407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:25.911071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:25.925604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5722e-19c8-496b-90c3-313b4acec22f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:25.933768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:25.934903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:25.935952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:25.936377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] PATH_INFO: `/v3/projects/73bd702f7b92452fa728414617551ffa` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:25.937970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bd702f7b92452fa728414617551ffa)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:25.940623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:26.028182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f886778ec88b40c3a68487c4d6f00603'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.152349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bd702f7b92452fa728414617551ffa', 'request_id': 'req-9e45d1eb-3143-4112-b16b-456e405f94a5'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.161801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bd702f7b92452fa728414617551ffa', 'request_id': 'req-9e45d1eb-3143-4112-b16b-456e405f94a5'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.166336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f886778ec88b40c3a68487c4d6f00603'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.181249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f886778ec88b40c3a68487c4d6f00603'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.188942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f886778ec88b40c3a68487c4d6f00603'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.189687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f886778ec88b40c3a68487c4d6f00603'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.196680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 920/1845] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:25 2022] DELETE /identity/v3/users/f886778ec88b40c3a68487c4d6f00603 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:26.266563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bd702f7b92452fa728414617551ffa', 'request_id': 'req-9e45d1eb-3143-4112-b16b-456e405f94a5'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.284226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] The token cache is being invalidate because project 73bd702f7b92452fa728414617551ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:26.284801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.285558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.287272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 926/1846] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:25 2022] DELETE /identity/v3/projects/73bd702f7b92452fa728414617551ffa => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:26.291417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:26.293020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:26.396027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33417ca-88ed-41db-9fd1-1ccdac56d914 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:26.401915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:26.402817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:26.403147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:26.403478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] PATH_INFO: `/v3/users/26ee0c9fe11641159186e9dbb8886e61` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:26.406250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ee0c9fe11641159186e9dbb8886e61)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:26.410787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:26.483397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:26.486465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:26.584432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45d1eb-3143-4112-b16b-456e405f94a5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:26.589968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:26.590937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:26.591221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:26.591528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] PATH_INFO: `/v3/projects/eae41c929f394e449eea9fc384b584a3` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:26.593053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae41c929f394e449eea9fc384b584a3)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:26.594995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:26.618989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ee0c9fe11641159186e9dbb8886e61'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.746420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ee0c9fe11641159186e9dbb8886e61'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.749797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:26.771451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ee0c9fe11641159186e9dbb8886e61'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.772109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae41c929f394e449eea9fc384b584a3', 'request_id': 'req-67d78376-6094-43e6-941d-609f947e6e30'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.782973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae41c929f394e449eea9fc384b584a3', 'request_id': 'req-67d78376-6094-43e6-941d-609f947e6e30'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.788541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ee0c9fe11641159186e9dbb8886e61'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.789580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-a708dc43-0108-4ee0-9a3e-72bdb53d809e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ee0c9fe11641159186e9dbb8886e61'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.799156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 921/1847] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:26 2022] DELETE /identity/v3/users/26ee0c9fe11641159186e9dbb8886e61 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:26.879344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae41c929f394e449eea9fc384b584a3', 'request_id': 'req-67d78376-6094-43e6-941d-609f947e6e30'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.909735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] The token cache is being invalidate because project eae41c929f394e449eea9fc384b584a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:26.910093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.910761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-67d78376-6094-43e6-941d-609f947e6e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:26.912899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 927/1848] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:26 2022] DELETE /identity/v3/projects/eae41c929f394e449eea9fc384b584a3 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:26.917386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370cb74-7444-4058-a459-98cd055e48d5 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:26.917680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370cb74-7444-4058-a459-98cd055e48d5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:26.918545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370cb74-7444-4058-a459-98cd055e48d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:26.941317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9370cb74-7444-4058-a459-98cd055e48d5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:26.942730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9370cb74-7444-4058-a459-98cd055e48d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:27.012210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 922/1849] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:27.020395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3f26-a75c-4c03-bbc2-b78fa588d9c0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:27.021096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3f26-a75c-4c03-bbc2-b78fa588d9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:27.021643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d3f26-a75c-4c03-bbc2-b78fa588d9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:27.051835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ec7d3f26-a75c-4c03-bbc2-b78fa588d9c0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:27.053208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ec7d3f26-a75c-4c03-bbc2-b78fa588d9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:27.063019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 928/1850] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:27.067631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370cb74-7444-4058-a459-98cd055e48d5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:27.079404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370cb74-7444-4058-a459-98cd055e48d5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:27.088360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:27.089178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:27.089491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:27.089776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:27.090517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:27.090928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:27.093395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:27.112789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 923/1851] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:27.114039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d3f26-a75c-4c03-bbc2-b78fa588d9c0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:27.126931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d3f26-a75c-4c03-bbc2-b78fa588d9c0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:27.149756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:27.151529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:27.152051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:27.154679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:27.160620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:27.164041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:27.327519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 929/1852] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:27 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:27.405677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:27.420844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21a80-d5d8-4630-b90b-cf71e9b9f0e5 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:27.540569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:27.540569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:27.540569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:27.540569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:27.541422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:27.541422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:27.541864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:27.543706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:27.550990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:27.560809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8c5ab-9356-4ff1-a322-f15fdd73b0e6 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:27.572823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:27.589688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:27.589688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:27.589688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] PATH_INFO: `/v3/projects/74990420de704d748636f3ea6f5cbe55` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:27.589688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74990420de704d748636f3ea6f5cbe55)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:27.589688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:27.892822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 924/1853] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:27 2022] POST /identity/v3/users => generated 282 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:27.899937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:27.912392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fabfaf-0acb-4886-9313-bfadf2fd69e2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:27.927689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:27.928783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:27.929105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:27.929522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:27.930411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:27.932324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:27.941464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74990420de704d748636f3ea6f5cbe55', 'request_id': 'req-f4330df2-5d73-49c8-aceb-12a015204a23'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:27.946297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 925/1854] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:27.950952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:27.951645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74990420de704d748636f3ea6f5cbe55', 'request_id': 'req-f4330df2-5d73-49c8-aceb-12a015204a23'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:27.962712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257ae8-5de4-4b76-9483-52bfff43977c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.038595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.039303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.039591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.043646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.043646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.043646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.047617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74990420de704d748636f3ea6f5cbe55', 'request_id': 'req-f4330df2-5d73-49c8-aceb-12a015204a23'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:28.058093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 926/1855] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:28.059213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.063093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] The token cache is being invalidate because project 74990420de704d748636f3ea6f5cbe55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:28.063394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:28.064278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f4330df2-5d73-49c8-aceb-12a015204a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:28.069097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 930/1856] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:27 2022] DELETE /identity/v3/projects/74990420de704d748636f3ea6f5cbe55 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:28.070648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b6ff-7bf3-40cb-a809-3949f239bba1 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.070948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b6ff-7bf3-40cb-a809-3949f239bba1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.071232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2b6ff-7bf3-40cb-a809-3949f239bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.078306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cee4fc-a051-4df3-b1be-7c82ab870cda admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.086261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16943d-4888-4db4-89ac-f4b97d7478df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.088111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16943d-4888-4db4-89ac-f4b97d7478df admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.088505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16943d-4888-4db4-89ac-f4b97d7478df admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.092019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16943d-4888-4db4-89ac-f4b97d7478df admin admin] PATH_INFO: `/v3/projects/805abe0e77a7427ba313cf7532efd7f2/users/8cb7464839124b40867717825c384be4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.094074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-96d2b6ff-7bf3-40cb-a809-3949f239bba1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:28.095285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-96d2b6ff-7bf3-40cb-a809-3949f239bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:28.104530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 931/1857] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:28.115657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71bc7-fb37-4155-be13-a95a237faa49 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.115657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71bc7-fb37-4155-be13-a95a237faa49 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.115657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b71bc7-fb37-4155-be13-a95a237faa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.117359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16943d-4888-4db4-89ac-f4b97d7478df admin admin] RBAC: Authorizing `identity:create_grant(project_id=805abe0e77a7427ba313cf7532efd7f2, user_id=8cb7464839124b40867717825c384be4, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.120103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16943d-4888-4db4-89ac-f4b97d7478df admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.142660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-67b71bc7-fb37-4155-be13-a95a237faa49 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:28.144848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-67b71bc7-fb37-4155-be13-a95a237faa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:28.154678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 932/1858] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:28.158781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71bc7-fb37-4155-be13-a95a237faa49 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.168377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b71bc7-fb37-4155-be13-a95a237faa49 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.174214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.174665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.174954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.175235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.176021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:28.176333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.178025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.190232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 933/1859] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:54:28.194554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.204906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c485fa-f94f-4bf1-a58a-2efb577beb39 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.209428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.210070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.210356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.210630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.211310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.213251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.240433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 927/1860] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:28 2022] PUT /identity/v3/projects/805abe0e77a7427ba313cf7532efd7f2/users/8cb7464839124b40867717825c384be4/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:28.250561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.250855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.251137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.277010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] MFA Rules not processed for user `8cb7464839124b40867717825c384be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:28.278239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:28.316837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 934/1861] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:28.321976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.371786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 928/1862] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:28.376271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.378654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:28.425555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5505aee-3818-4f12-94fa-d4e976967e4e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.429594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.430358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.430713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.431116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.432033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.434195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.473071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3640763-3f96-4172-a0a8-68f71ce685c7 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.479290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.480277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.480814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.482780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.482780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.487411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.550542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 935/1863] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:28.555503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.571787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2e741-668e-43e5-86bd-62917445f930 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.577533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.578192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.578484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.578759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.579546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.581178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.590605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 929/1864] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/projects => generated 365 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:28.593731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 936/1865] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:28.595518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.597088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.606996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a4178-3fe6-4cf3-9cc0-b05355839a4f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.660769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121c126e-5de8-4ad1-882a-b7c8c5761112 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.665715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.666389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.666682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.666992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.667714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.667986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.668698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.668986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.669266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.669936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.670049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.671615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.681590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 937/1866] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:28.686255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.695556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc16883-22c1-4fb7-b3f2-1819ca96265d admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.700673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd9aa1-b54c-4f3b-a8d9-8915d8fd0a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.702236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd9aa1-b54c-4f3b-a8d9-8915d8fd0a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.708481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd9aa1-b54c-4f3b-a8d9-8915d8fd0a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.708481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd9aa1-b54c-4f3b-a8d9-8915d8fd0a67 admin admin] PATH_INFO: `/v3/projects/406ad56bb0f54ef0a5cba7b649bd6e7f/users/30b4ea1c90d94d1888c1ad2050e5f572/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.722489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd9aa1-b54c-4f3b-a8d9-8915d8fd0a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=406ad56bb0f54ef0a5cba7b649bd6e7f, user_id=30b4ea1c90d94d1888c1ad2050e5f572, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.725354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dd9aa1-b54c-4f3b-a8d9-8915d8fd0a67 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.795809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 930/1867] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:28.799208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.808937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc53d3-afc6-4ca2-8ce5-5e53d4c974ec admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.814213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.815536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.815831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.816124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.816901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:28.818502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:28.836092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 931/1869] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:28.842724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 938/1869] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:28 2022] PUT /identity/v3/projects/406ad56bb0f54ef0a5cba7b649bd6e7f/users/30b4ea1c90d94d1888c1ad2050e5f572/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:28.847953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.850942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7411a-a069-4fac-a2e8-f8acd797d06c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.851453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7411a-a069-4fac-a2e8-f8acd797d06c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.853153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7411a-a069-4fac-a2e8-f8acd797d06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:28.881905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29101856-e457-4809-8847-0e614976d1e8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:28.894262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2cf7411a-a069-4fac-a2e8-f8acd797d06c None None] MFA Rules not processed for user `30b4ea1c90d94d1888c1ad2050e5f572`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:28.896023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2cf7411a-a069-4fac-a2e8-f8acd797d06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:28.978571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 939/1870] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:28.989126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:28.990007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7411a-a069-4fac-a2e8-f8acd797d06c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:28.990121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:28.990298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:28.990575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] PATH_INFO: `/v3/projects/c554257d23644a1e8f4746c48df301a5/users/5b6a4973dd324c3b86555ad674bc0a6b/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.001798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7411a-a069-4fac-a2e8-f8acd797d06c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.007116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.007856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.008210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.008594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.008718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=c554257d23644a1e8f4746c48df301a5, user_id=5b6a4973dd324c3b86555ad674bc0a6b, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.009406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.011477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.011604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.097848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 932/1871] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:28 2022] PUT /identity/v3/projects/c554257d23644a1e8f4746c48df301a5/users/5b6a4973dd324c3b86555ad674bc0a6b/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:29.101576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.125542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 940/1872] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:28 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:29.127093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.172888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159820cd-6192-4dcb-9a1a-8f3a73d901ba admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.191049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:29.195537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0e4c8-b0d6-4230-9cd1-c7ae7944ac13 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.202666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.202666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.203062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.203224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.203933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.205973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.223716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:29.242122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.242510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.242808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.243089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.243818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.245498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.256630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 933/1873] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:29.260636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.271204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926805-3b16-4858-88d4-261622b4b6ef admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.275882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42f4d3-b79b-4d4b-943b-9b6136665ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.276843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42f4d3-b79b-4d4b-943b-9b6136665ef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.277158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42f4d3-b79b-4d4b-943b-9b6136665ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.277444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42f4d3-b79b-4d4b-943b-9b6136665ef5 admin admin] PATH_INFO: `/v3/projects/c554257d23644a1e8f4746c48df301a5/users/5b6a4973dd324c3b86555ad674bc0a6b/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.280026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42f4d3-b79b-4d4b-943b-9b6136665ef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c554257d23644a1e8f4746c48df301a5, user_id=5b6a4973dd324c3b86555ad674bc0a6b, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.282904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42f4d3-b79b-4d4b-943b-9b6136665ef5 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.293553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 934/1874] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:29 2022] PUT /identity/v3/projects/c554257d23644a1e8f4746c48df301a5/users/5b6a4973dd324c3b86555ad674bc0a6b/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:29.296993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 941/1875] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:29 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:29.305231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.305466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.305749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.306945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.318169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1145-f645-4d6c-aa3a-51656b1ba892 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.332909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] MFA Rules not processed for user `5b6a4973dd324c3b86555ad674bc0a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:29.334080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:29.376850 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.377632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.377950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.378384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.379309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.381073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.391189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 942/1876] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:29.396332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.405279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a8eeb-dd7e-4fa3-8a5c-609ed0d2576d admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.410576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 935/1877] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:29.410726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.411335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.411622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.411903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] PATH_INFO: `/v3/projects/d1372f1e1ddf4819abcd9a157129c97d/users/bb1e29be8ef3432da05dce2507940d76/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.417854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.419310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:29.431423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1372f1e1ddf4819abcd9a157129c97d, user_id=bb1e29be8ef3432da05dce2507940d76, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.434117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.479421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d77ec3-7589-4519-b6ba-ea7dee932317 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.484524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.488080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.488080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.488080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.495467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.496971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.510813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 936/1878] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:29.527139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 943/1879] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:29 2022] PUT /identity/v3/projects/d1372f1e1ddf4819abcd9a157129c97d/users/bb1e29be8ef3432da05dce2507940d76/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:29.531140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.541407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966bc67-a072-4576-b91a-c4b589b6b0b4 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.603330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36331e-afb3-44ba-bd80-65ab10586216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.604015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36331e-afb3-44ba-bd80-65ab10586216 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.604350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36331e-afb3-44ba-bd80-65ab10586216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.604682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36331e-afb3-44ba-bd80-65ab10586216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.605433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36331e-afb3-44ba-bd80-65ab10586216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.607219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36331e-afb3-44ba-bd80-65ab10586216 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.618428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 937/1880] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:29.622413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.637185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee44cad-2cea-4615-8dbb-935e2c3bdc8e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.643296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.644215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.644545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.645160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] PATH_INFO: `/v3/projects/d1372f1e1ddf4819abcd9a157129c97d/users/bb1e29be8ef3432da05dce2507940d76/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.647246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1372f1e1ddf4819abcd9a157129c97d, user_id=bb1e29be8ef3432da05dce2507940d76, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.655110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.666657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 944/1881] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:29 2022] PUT /identity/v3/projects/d1372f1e1ddf4819abcd9a157129c97d/users/bb1e29be8ef3432da05dce2507940d76/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:29.676966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.677264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.677571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.705539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] MFA Rules not processed for user `bb1e29be8ef3432da05dce2507940d76`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:29.706765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:29.774611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.782291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 938/1882] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:29.831612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf260e8-233d-4a64-af0d-11a8a2ac8bd6 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.835244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.835890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.836173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.836488 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.913678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.915655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.926407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 945/1883] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:29.930853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:29.932867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:29.946765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f7846-6c55-401e-813e-41a89eff778b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:29.951712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:29.952512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:29.953744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:29.953744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:29.965207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:29.968679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:29.978426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 939/1884] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:30.293001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:30.401411 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:30.784907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:30.787131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:30.897317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9ea66b-d18a-4376-a5ad-950f3c6337f2 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:30.906241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:30.907087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:30.907752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:30.908049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] PATH_INFO: `/v3/users/6e3be654b5e6494b9fd85a8042d31eb4` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:30.910261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3be654b5e6494b9fd85a8042d31eb4)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:30.912878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:31.064205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:31.090419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e37192e-20c2-4a0a-8ff1-a56682feb552 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:31.111674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:31.112656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:31.113148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:31.113576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] PATH_INFO: `/v3/users/30b4ea1c90d94d1888c1ad2050e5f572` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:31.115540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30b4ea1c90d94d1888c1ad2050e5f572)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:31.118644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:31.211972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:31.235743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3be654b5e6494b9fd85a8042d31eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.347077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3be654b5e6494b9fd85a8042d31eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.365164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3be654b5e6494b9fd85a8042d31eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.377677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3be654b5e6494b9fd85a8042d31eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.378515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3be654b5e6494b9fd85a8042d31eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.394304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:31.398676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 946/1885] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:30 2022] DELETE /identity/v3/users/6e3be654b5e6494b9fd85a8042d31eb4 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:31.399461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:31.401071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:31.406898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30b4ea1c90d94d1888c1ad2050e5f572'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.485730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30b4ea1c90d94d1888c1ad2050e5f572'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.500675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30b4ea1c90d94d1888c1ad2050e5f572'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.504381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e783-56b8-4c72-9c71-109efd71b2ba admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:31.508231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2067bd-4ea7-4784-adc7-318f67b6a3c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:31.508946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2067bd-4ea7-4784-adc7-318f67b6a3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:31.509238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2067bd-4ea7-4784-adc7-318f67b6a3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:31.509521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2067bd-4ea7-4784-adc7-318f67b6a3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:31.511764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ce2067bd-4ea7-4784-adc7-318f67b6a3c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:31.519386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30b4ea1c90d94d1888c1ad2050e5f572'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.520575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0fd5d2d-c96b-41c2-8653-900307a51673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30b4ea1c90d94d1888c1ad2050e5f572'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:31.530028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 940/1886] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:31 2022] DELETE /identity/v3/users/30b4ea1c90d94d1888c1ad2050e5f572 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:31.531868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:31.532330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:31.532813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:31.562819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:31.564186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:31.594883 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2067bd-4ea7-4784-adc7-318f67b6a3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:31.596397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2067bd-4ea7-4784-adc7-318f67b6a3c1 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:31.608743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 947/1887] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:31.610301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:31.610663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:31.610950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:31.634668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:31.639118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:31.649168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 948/1888] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:31.657872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:31.659610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:31.663890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 941/1889] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:31.670739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:31.674125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:31.774085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c95a3-cbdd-4b54-ae0a-395287b91c29 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:31.785383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7285cb4-af71-413a-ac60-8c6a5f862f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:31.786527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285cb4-af71-413a-ac60-8c6a5f862f8c service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:31.792024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285cb4-af71-413a-ac60-8c6a5f862f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:31.792564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7285cb4-af71-413a-ac60-8c6a5f862f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:31.805083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9068d-ff88-44c3-b7f2-1704b4bd23d6 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:31.819730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:31.820465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:31.821943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:31.822230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:31.836964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:31.838578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:31.843135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7285cb4-af71-413a-ac60-8c6a5f862f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:31.848966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7285cb4-af71-413a-ac60-8c6a5f862f8c service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:31.865435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 942/1890] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:31.866416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:31.873650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:31.880990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 949/1891] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:31.900308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77316622-69d0-473c-a905-0f250970dc83 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:31.912835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:31.914302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:31.915092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:31.915594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] PATH_INFO: `/v3/users/33b567a1b4a743179e258995a74d370a` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:31.917265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b567a1b4a743179e258995a74d370a)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:31.920675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:32.172132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b567a1b4a743179e258995a74d370a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:32.303123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b567a1b4a743179e258995a74d370a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:32.320625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b567a1b4a743179e258995a74d370a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:32.328258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b567a1b4a743179e258995a74d370a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:32.329179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b567a1b4a743179e258995a74d370a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:32.335295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 943/1892] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:31 2022] DELETE /identity/v3/users/33b567a1b4a743179e258995a74d370a => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:32.339914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:32.340270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:32.340599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:32.359293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:32.360551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:32.418014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:32.452982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 950/1893] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:32.465371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:32.467442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:32.558303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050cd11-5faf-4f5d-9f75-2e29b2065800 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:32.562665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:32.563500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:32.563962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:32.564247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:32.580295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:32.582689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:32.598921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 944/1894] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:32.652829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:32.655154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:32.682651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59264df-1164-4962-87eb-bf84edabe9a2 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:32.697622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:32.698053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:32.698340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:32.698614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] PATH_INFO: `/v3/projects/69bd2650f6574f4a861d1681a4eddbc0` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:32.700216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69bd2650f6574f4a861d1681a4eddbc0)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:32.702315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:32.853504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69bd2650f6574f4a861d1681a4eddbc0', 'request_id': 'req-aa35a7b4-301f-44b0-a724-6093f1e13a80'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:32.861089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69bd2650f6574f4a861d1681a4eddbc0', 'request_id': 'req-aa35a7b4-301f-44b0-a724-6093f1e13a80'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:33.749514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69bd2650f6574f4a861d1681a4eddbc0', 'request_id': 'req-aa35a7b4-301f-44b0-a724-6093f1e13a80'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:33.765124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:33.765124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:33.779811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] The token cache is being invalidate because project 69bd2650f6574f4a861d1681a4eddbc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:33.780016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:33.780667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323efb6c-03c1-41ea-bcfd-6250ba5dde28 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:33.780780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:33.787152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 951/1895] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:32 2022] DELETE /identity/v3/projects/69bd2650f6574f4a861d1681a4eddbc0 => generated 0 bytes in 1132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:33.788531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:33.805617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:33.884517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:33.885862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:33.886824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:33.888321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] PATH_INFO: `/v3/projects/406ad56bb0f54ef0a5cba7b649bd6e7f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:33.891678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=406ad56bb0f54ef0a5cba7b649bd6e7f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:33.894540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:33.944596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa35a7b4-301f-44b0-a724-6093f1e13a80 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:33.960790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:33.962527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:33.963051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:33.963619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] PATH_INFO: `/v3/users/60d993792d3240ad8ba2f50ffc8e3008` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:33.965792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d993792d3240ad8ba2f50ffc8e3008)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:33.967761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:34.075989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '406ad56bb0f54ef0a5cba7b649bd6e7f', 'request_id': 'req-2d861c0e-df48-4728-872b-3e9e08d62dd1'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.099008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '406ad56bb0f54ef0a5cba7b649bd6e7f', 'request_id': 'req-2d861c0e-df48-4728-872b-3e9e08d62dd1'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.240931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '406ad56bb0f54ef0a5cba7b649bd6e7f', 'request_id': 'req-2d861c0e-df48-4728-872b-3e9e08d62dd1'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.264287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] The token cache is being invalidate because project 406ad56bb0f54ef0a5cba7b649bd6e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:34.265261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.266772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.272088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 945/1896] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:33 2022] DELETE /identity/v3/projects/406ad56bb0f54ef0a5cba7b649bd6e7f => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:34.272614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d993792d3240ad8ba2f50ffc8e3008'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.274810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:34.283754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:34.362491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d861c0e-df48-4728-872b-3e9e08d62dd1 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:34.368425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:34.369345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:34.369638 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:34.369921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] PATH_INFO: `/v3/users/bb1e29be8ef3432da05dce2507940d76` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:34.371133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1e29be8ef3432da05dce2507940d76)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:34.373303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:34.435942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d993792d3240ad8ba2f50ffc8e3008'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.447083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:34.473063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d993792d3240ad8ba2f50ffc8e3008'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.481537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d993792d3240ad8ba2f50ffc8e3008'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.482635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d993792d3240ad8ba2f50ffc8e3008'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.495813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 952/1897] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:33 2022] DELETE /identity/v3/users/60d993792d3240ad8ba2f50ffc8e3008 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:34.495813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:34.502506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:34.603643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56517f-f110-4538-af83-e6d432a90d11 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:34.608695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:34.610349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:34.610918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:34.610918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] PATH_INFO: `/v3/projects/41a0ac1e5bcd468caf81039d3d2bd711` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:34.612186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a0ac1e5bcd468caf81039d3d2bd711)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:34.614198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:34.616701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1e29be8ef3432da05dce2507940d76'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.663056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1e29be8ef3432da05dce2507940d76'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.676270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1e29be8ef3432da05dce2507940d76'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.682909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1e29be8ef3432da05dce2507940d76'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.683609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1e29be8ef3432da05dce2507940d76'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.689696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 946/1898] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:34 2022] DELETE /identity/v3/users/bb1e29be8ef3432da05dce2507940d76 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:34.743034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a0ac1e5bcd468caf81039d3d2bd711', 'request_id': 'req-1b32975f-8575-4add-ba06-906b0c2fc658'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.751742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a0ac1e5bcd468caf81039d3d2bd711', 'request_id': 'req-1b32975f-8575-4add-ba06-906b0c2fc658'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.798130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a0ac1e5bcd468caf81039d3d2bd711', 'request_id': 'req-1b32975f-8575-4add-ba06-906b0c2fc658'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.839442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] The token cache is being invalidate because project 41a0ac1e5bcd468caf81039d3d2bd711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:34.839745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.840475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:34.842086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 953/1899] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:34 2022] DELETE /identity/v3/projects/41a0ac1e5bcd468caf81039d3d2bd711 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:34.846832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:34.848293 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:34.925536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45eebe-8fbb-4d55-b719-dbc8103d9e1e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:34.996903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:34.998147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:34.998600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:34.999034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] PATH_INFO: `/v3/users/a85bf9c83bed42d6b8c1c595d645334c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.001105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85bf9c83bed42d6b8c1c595d645334c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:35.003192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:35.034928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:35.037180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:35.066693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b32975f-8575-4add-ba06-906b0c2fc658 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:35.074548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:35.075595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.076382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.076712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] PATH_INFO: `/v3/projects/789ee07e186d4524b4469513cdec07a8` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.078070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=789ee07e186d4524b4469513cdec07a8)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:35.081758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:35.331475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85bf9c83bed42d6b8c1c595d645334c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.347326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '789ee07e186d4524b4469513cdec07a8', 'request_id': 'req-a3f903a7-660b-4f1a-bcfc-328454f54cec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.353837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '789ee07e186d4524b4469513cdec07a8', 'request_id': 'req-a3f903a7-660b-4f1a-bcfc-328454f54cec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.421003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85bf9c83bed42d6b8c1c595d645334c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.433896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85bf9c83bed42d6b8c1c595d645334c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.442025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85bf9c83bed42d6b8c1c595d645334c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.442839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85bf9c83bed42d6b8c1c595d645334c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.449144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 947/1900] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:34 2022] DELETE /identity/v3/users/a85bf9c83bed42d6b8c1c595d645334c => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:35.450344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:35.451705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:35.513699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '789ee07e186d4524b4469513cdec07a8', 'request_id': 'req-a3f903a7-660b-4f1a-bcfc-328454f54cec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.545793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] The token cache is being invalidate because project 789ee07e186d4524b4469513cdec07a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:35.546022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.548685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a3f903a7-660b-4f1a-bcfc-328454f54cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.556314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 954/1901] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:35 2022] DELETE /identity/v3/projects/789ee07e186d4524b4469513cdec07a8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:35.558340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94df551-7b58-4a7f-b6b5-15cdfe3dd084 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.558640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94df551-7b58-4a7f-b6b5-15cdfe3dd084 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.558950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94df551-7b58-4a7f-b6b5-15cdfe3dd084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.574615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aa834-f1bf-4173-9458-434541983df9 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:35.580947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:35.581840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.582132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.582416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] PATH_INFO: `/v3/projects/d1372f1e1ddf4819abcd9a157129c97d` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.583757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1372f1e1ddf4819abcd9a157129c97d)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:35.585901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:35.616580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e94df551-7b58-4a7f-b6b5-15cdfe3dd084 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:35.621507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e94df551-7b58-4a7f-b6b5-15cdfe3dd084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:35.636562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 955/1902] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:35.643853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0064b1a-01fd-445b-b401-2432b995d2a1 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.644153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0064b1a-01fd-445b-b401-2432b995d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.644459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0064b1a-01fd-445b-b401-2432b995d2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.665195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c0064b1a-01fd-445b-b401-2432b995d2a1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:35.666580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c0064b1a-01fd-445b-b401-2432b995d2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:35.677341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 956/1903] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:35.682188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0064b1a-01fd-445b-b401-2432b995d2a1 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:35.699139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0064b1a-01fd-445b-b401-2432b995d2a1 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:35.719434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1372f1e1ddf4819abcd9a157129c97d', 'request_id': 'req-db8324cf-9b18-4b3e-b559-776695a76eef'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.734310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1372f1e1ddf4819abcd9a157129c97d', 'request_id': 'req-db8324cf-9b18-4b3e-b559-776695a76eef'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.809687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1372f1e1ddf4819abcd9a157129c97d', 'request_id': 'req-db8324cf-9b18-4b3e-b559-776695a76eef'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.819860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:35.820722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.821054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.823193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.823193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:35.823193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:35.824010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:35.833324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] The token cache is being invalidate because project d1372f1e1ddf4819abcd9a157129c97d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:35.833749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.834522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-db8324cf-9b18-4b3e-b559-776695a76eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:35.839852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 948/1904] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:35 2022] DELETE /identity/v3/projects/d1372f1e1ddf4819abcd9a157129c97d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:35.840951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 957/1905] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:54:35.841455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1df77-8c97-4130-a1fe-3012cc0ffb1a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.841815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1df77-8c97-4130-a1fe-3012cc0ffb1a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.842165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1df77-8c97-4130-a1fe-3012cc0ffb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.843487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:35.846644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:35.863719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e159b-1472-4b6a-9fc1-a570374df2fd admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:35.879579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:35.880262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.885048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.885048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.885048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:35.885048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:35.887658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6be1df77-8c97-4130-a1fe-3012cc0ffb1a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:35.888971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6be1df77-8c97-4130-a1fe-3012cc0ffb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:35.902017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:35.906158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 949/1906] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:35.908652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa354e-d9cb-4862-b9e4-b030bd77375d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.911480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa354e-d9cb-4862-b9e4-b030bd77375d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.911480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa354e-d9cb-4862-b9e4-b030bd77375d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.935674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f1aa354e-d9cb-4862-b9e4-b030bd77375d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:35.939125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f1aa354e-d9cb-4862-b9e4-b030bd77375d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:35.954643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 950/1907] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:35.963244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa354e-d9cb-4862-b9e4-b030bd77375d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:35.972076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa354e-d9cb-4862-b9e4-b030bd77375d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:35.979290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:35.980065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:35.980528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:35.980894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:35.982018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:35.982445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:35.984505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:35.997223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 951/1908] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:36.001216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.010947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad25436-14cf-4bf8-aa32-08c13d36f339 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.019048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.019048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.019048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.019048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.019549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.020507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.022858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 958/1909] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:35 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:36.024085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.027394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:36.096326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8fcb7-7074-4a55-845b-46336f8a1be2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.101120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.101979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.102269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.102596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] PATH_INFO: `/v3/projects/f30affc4f0074e91bc85e6d2a6fd7d15` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.103762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30affc4f0074e91bc85e6d2a6fd7d15)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.108041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.122468 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 952/1910] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:36 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:36.123739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.189395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf7852-9c8f-4480-8a6b-cc1e29d1bedc admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.194199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.194870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.195161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.195444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.196138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.198101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.234871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30affc4f0074e91bc85e6d2a6fd7d15', 'request_id': 'req-51cd154e-3f26-4236-93f1-224c2f0b70a4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:36.242530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30affc4f0074e91bc85e6d2a6fd7d15', 'request_id': 'req-51cd154e-3f26-4236-93f1-224c2f0b70a4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:36.302294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30affc4f0074e91bc85e6d2a6fd7d15', 'request_id': 'req-51cd154e-3f26-4236-93f1-224c2f0b70a4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:36.311988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 953/1911] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:36 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:36.311988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.318171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] The token cache is being invalidate because project f30affc4f0074e91bc85e6d2a6fd7d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:36.318465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:36.319309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:36.320787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4899354d-0cdf-4158-8548-fa808615497c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.321009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 959/1912] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:36 2022] DELETE /identity/v3/projects/f30affc4f0074e91bc85e6d2a6fd7d15 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:36.321722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.323018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:36.409915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.410820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.411262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.411871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.412763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.415029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.452948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd154e-3f26-4236-93f1-224c2f0b70a4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.460270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d63e3-2796-4f5c-8b36-8e822d318896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.461610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d63e3-2796-4f5c-8b36-8e822d318896 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.462086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d63e3-2796-4f5c-8b36-8e822d318896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.462952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d63e3-2796-4f5c-8b36-8e822d318896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.463880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d63e3-2796-4f5c-8b36-8e822d318896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.465743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d63e3-2796-4f5c-8b36-8e822d318896 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.502794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 960/1913] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:36.504555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.504555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.504848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.534359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:36.535671 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:36.539517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 954/1914] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:36 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:36.540268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.558320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be4a99-7d8b-49e2-8fa0-9e2c3d6c5af4 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.570612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 961/1915] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:36.571017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.573407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:36.575974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d3bb1-3838-43e6-b4b5-3543988d7fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.577292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d3bb1-3838-43e6-b4b5-3543988d7fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.580424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d3bb1-3838-43e6-b4b5-3543988d7fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.580799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d3bb1-3838-43e6-b4b5-3543988d7fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.581681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d3bb1-3838-43e6-b4b5-3543988d7fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.583745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069d3bb1-3838-43e6-b4b5-3543988d7fb8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.606356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe764c-8c68-4ec5-abad-ac8a39133088 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.612643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 955/1916] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:36.614143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd4fd9-0b30-4c35-9b96-0267baa6c553 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.614549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd4fd9-0b30-4c35-9b96-0267baa6c553 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.614953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd4fd9-0b30-4c35-9b96-0267baa6c553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.619855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.620854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.621147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.621435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.625006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.633008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.652309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 962/1917] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:36.655648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.661047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-dddd4fd9-0b30-4c35-9b96-0267baa6c553 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:36.663125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-dddd4fd9-0b30-4c35-9b96-0267baa6c553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:36.669206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cda07-f0db-4303-bf94-54a5fe145224 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.674980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.675882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.676168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.676486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] PATH_INFO: `/v3/projects/34fb47f0e4134ed49a5c891b70aea29a/users/68ac3a701e9a4916b21c64d9a8d6e93e/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.677495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 956/1918] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:36.678603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd4fd9-0b30-4c35-9b96-0267baa6c553 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.697164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fb47f0e4134ed49a5c891b70aea29a, user_id=68ac3a701e9a4916b21c64d9a8d6e93e, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.700541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.705957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd4fd9-0b30-4c35-9b96-0267baa6c553 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.711256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.712217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.712759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.713382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.714394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.716094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.728152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 957/1919] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:36.729189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.740330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4fd9a-b19b-4869-b243-6fb2638b8565 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.745490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.746236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.746591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.746931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.747718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:36.748088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.749772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.762034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 958/1920] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:36.762853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.774069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 963/1921] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:36 2022] PUT /identity/v3/projects/34fb47f0e4134ed49a5c891b70aea29a/users/68ac3a701e9a4916b21c64d9a8d6e93e/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:36.775237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:36.775382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7318d-164d-44fc-97e4-0e0366fe62b4 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.855497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52e9a4-5593-4c4c-8d2b-3aae7a4dce33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.856459 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52e9a4-5593-4c4c-8d2b-3aae7a4dce33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.856817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52e9a4-5593-4c4c-8d2b-3aae7a4dce33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.857165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52e9a4-5593-4c4c-8d2b-3aae7a4dce33 admin admin] PATH_INFO: `/v3/projects/76ed0a6ca51b4eacb4761fa2a08388be/users/56cfdc03ce6c47979aaa6e2dcfec7fbb/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.865689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7572c494-fdf3-4d03-8196-9b4c4ca2c8bf admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:36.873177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89979786-2c36-4d7f-b35c-d4acf1bedfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:36.875882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89979786-2c36-4d7f-b35c-d4acf1bedfca admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.876545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89979786-2c36-4d7f-b35c-d4acf1bedfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.876895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52e9a4-5593-4c4c-8d2b-3aae7a4dce33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ed0a6ca51b4eacb4761fa2a08388be, user_id=56cfdc03ce6c47979aaa6e2dcfec7fbb, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.877183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89979786-2c36-4d7f-b35c-d4acf1bedfca admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:36.878287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89979786-2c36-4d7f-b35c-d4acf1bedfca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:36.879854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52e9a4-5593-4c4c-8d2b-3aae7a4dce33 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.880914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89979786-2c36-4d7f-b35c-d4acf1bedfca admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:36.960431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:36.966682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 959/1922] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:36 2022] PUT /identity/v3/projects/76ed0a6ca51b4eacb4761fa2a08388be/users/56cfdc03ce6c47979aaa6e2dcfec7fbb/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:36.968067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b818-8ded-47f7-a526-d1f053cb2a14 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:36.968361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b818-8ded-47f7-a526-d1f053cb2a14 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:36.968736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0947b818-8ded-47f7-a526-d1f053cb2a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.002215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0947b818-8ded-47f7-a526-d1f053cb2a14 None None] MFA Rules not processed for user `68ac3a701e9a4916b21c64d9a8d6e93e`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:37.003524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0947b818-8ded-47f7-a526-d1f053cb2a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:37.040656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 964/1923] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:36 2022] POST /identity/v3/projects => generated 383 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:37.042130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d423fb-e4a5-425a-8e10-f88c4f2de1cd None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.042696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d423fb-e4a5-425a-8e10-f88c4f2de1cd None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.043033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d423fb-e4a5-425a-8e10-f88c4f2de1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.074495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e0d423fb-e4a5-425a-8e10-f88c4f2de1cd None None] MFA Rules not processed for user `56cfdc03ce6c47979aaa6e2dcfec7fbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:37.075639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e0d423fb-e4a5-425a-8e10-f88c4f2de1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:37.080461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 960/1924] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:37.081239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947b818-8ded-47f7-a526-d1f053cb2a14 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.145406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 965/1925] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:37.146609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d423fb-e4a5-425a-8e10-f88c4f2de1cd None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.153962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0947b818-8ded-47f7-a526-d1f053cb2a14 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.216158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.217011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.217303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.217695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.218639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.220059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d423fb-e4a5-425a-8e10-f88c4f2de1cd None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.222331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.225765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.226533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.230150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.230150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.230150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.230150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.312138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 961/1926] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:37 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:37.314183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.315974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:37.344756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 966/1927] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:37 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:37.344756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.375016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c9c9b-c074-4ba6-a5f2-8de49296cbf1 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.406050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae03c707-1817-421a-a399-6e95a35800ef admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.411099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.411778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.412062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.412342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.413116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.414735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.424847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.425504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.425790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.426074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.426299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 967/1928] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:37.427231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.436906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2f206-4830-4bb5-bc13-58e12b64f5d4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.442568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.443228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.443520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.443806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.444526 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.446464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.484223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.486590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.495811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 962/1929] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:37.496646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.508497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355a9b8-ad0d-4f7a-a56f-9dc34bbf432c service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.513257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.513981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.514272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.514554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.515277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.517090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.527382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 963/1930] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:37.531493 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.541354 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356dd3b1-29ca-4a64-a2d4-3f35c374cc6e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.546163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0cbc0-568a-4d2a-b042-c096183a5f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.547505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0cbc0-568a-4d2a-b042-c096183a5f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.548079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0cbc0-568a-4d2a-b042-c096183a5f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.548569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0cbc0-568a-4d2a-b042-c096183a5f11 admin admin] PATH_INFO: `/v3/projects/219520a0d6ba4396b95ddf5914b8fc25/users/379bf4561f644b2cb027914ab26f8a45/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.565270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0cbc0-568a-4d2a-b042-c096183a5f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219520a0d6ba4396b95ddf5914b8fc25, user_id=379bf4561f644b2cb027914ab26f8a45, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.568024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0cbc0-568a-4d2a-b042-c096183a5f11 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.596375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 968/1931] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:37 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:37.597494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.607329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a56de9-3197-4be6-86f0-751948eb4a77 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.613469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.614209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.614501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.614783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.615505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.617167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.628851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 969/1932] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:37.633083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.642580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089713-e2db-42e1-871a-0b5f5eb866f5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.647171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.648026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.648312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.648626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] PATH_INFO: `/v3/projects/29e931ae5138418d810091c26599153c/users/381512122de8458693ef5a702f255c05/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.664455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e931ae5138418d810091c26599153c, user_id=381512122de8458693ef5a702f255c05, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.667194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.701842 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 964/1933] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:37 2022] PUT /identity/v3/projects/219520a0d6ba4396b95ddf5914b8fc25/users/379bf4561f644b2cb027914ab26f8a45/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:37.713767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03730a-63c5-436a-9bb3-be66b7321fcd None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.714319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03730a-63c5-436a-9bb3-be66b7321fcd None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.714600 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc03730a-63c5-436a-9bb3-be66b7321fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.742624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bc03730a-63c5-436a-9bb3-be66b7321fcd None None] MFA Rules not processed for user `379bf4561f644b2cb027914ab26f8a45`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:37.743877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bc03730a-63c5-436a-9bb3-be66b7321fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:37.784026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 970/1934] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:37 2022] PUT /identity/v3/projects/29e931ae5138418d810091c26599153c/users/381512122de8458693ef5a702f255c05/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:37.787867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.826990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 965/1935] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:37.833106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03730a-63c5-436a-9bb3-be66b7321fcd None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.863019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1eb5c-a57b-4567-b2e4-89612b817306 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.868393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.870729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.870729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.870729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.870729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.872111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.884149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 971/1936] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:37.887981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:37.901000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6fe10-7835-43fe-b280-b0eecaeeb853 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.903699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31312a-1ef3-4f4d-a488-dffa05ffc319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.904612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31312a-1ef3-4f4d-a488-dffa05ffc319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.904900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31312a-1ef3-4f4d-a488-dffa05ffc319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.905180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31312a-1ef3-4f4d-a488-dffa05ffc319 admin admin] PATH_INFO: `/v3/projects/29e931ae5138418d810091c26599153c/users/381512122de8458693ef5a702f255c05/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.906973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc03730a-63c5-436a-9bb3-be66b7321fcd None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:37.907459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31312a-1ef3-4f4d-a488-dffa05ffc319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e931ae5138418d810091c26599153c, user_id=381512122de8458693ef5a702f255c05, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.910145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31312a-1ef3-4f4d-a488-dffa05ffc319 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.912517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:37.913060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.913422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.913862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.914579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:37.916570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:37.923738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 972/1937] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:37 2022] PUT /identity/v3/projects/29e931ae5138418d810091c26599153c/users/381512122de8458693ef5a702f255c05/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:37.939420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:37.939712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:37.939997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:37.970460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] MFA Rules not processed for user `381512122de8458693ef5a702f255c05`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:37.972721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.042566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 973/1938] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:38.043417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.045161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.060506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 966/1939] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:37 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:38.060506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.066057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.118186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552250e-4c97-4903-8522-cb8e7521dcda None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.132774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db11dcf-c66e-4cc0-98bd-7977f872fd79 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.136884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.137535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.138362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.138362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.194893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.195786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.196078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.196360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] PATH_INFO: `/v3/users/c14368ffd9d541f4b166decbb3826eff` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.197644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14368ffd9d541f4b166decbb3826eff)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.199892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.210899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.212467 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.221539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:38.227580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 967/1940] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:38.228773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.240954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9d7bb-4246-4cad-8f5c-01336f5f4af7 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.246371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.247123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.247491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.247838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.249908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.252275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.399161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 968/1941] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:38 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:38.400220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.428890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfcce95-ecad-4174-8662-339daa18d346 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.433915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.434596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.434887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.435167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.435901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.437645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.448550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 969/1942] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:38.452712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.455234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14368ffd9d541f4b166decbb3826eff'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:38.463897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8500dcc-3f5a-4929-b4fd-e1af76ad9294 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.468595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.470556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.470873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.471152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] PATH_INFO: `/v3/projects/04d989a74aee4322b23df8d06f891728/users/246aec51c8c84011b72a6fcbbdb6502b/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.486541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d989a74aee4322b23df8d06f891728, user_id=246aec51c8c84011b72a6fcbbdb6502b, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.489449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.569822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14368ffd9d541f4b166decbb3826eff'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:38.575489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 970/1943] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:38 2022] PUT /identity/v3/projects/04d989a74aee4322b23df8d06f891728/users/246aec51c8c84011b72a6fcbbdb6502b/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:38.579535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.586400 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14368ffd9d541f4b166decbb3826eff'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:38.593622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14368ffd9d541f4b166decbb3826eff'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:38.594954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-70a33e94-5af7-4c66-8d72-d562ee3179ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14368ffd9d541f4b166decbb3826eff'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:38.600919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 974/1944] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:38 2022] DELETE /identity/v3/users/c14368ffd9d541f4b166decbb3826eff => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:38.611298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.611588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.611867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.629960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:38.631327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.643336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b2479-50e9-42cf-a40d-913dfe24ac14 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.703121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.704012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.704305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.704618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.705372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.706720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 975/1945] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:38.706992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.716448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.717796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.717901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 971/1946] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:38.722923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.724658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.738051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214a960-9f49-439e-9212-c30771b63a03 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.742783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0d9d8-9a97-4ac0-85c1-e0ecf0f7d0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.743665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d9d8-9a97-4ac0-85c1-e0ecf0f7d0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.743957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d9d8-9a97-4ac0-85c1-e0ecf0f7d0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.744243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0d9d8-9a97-4ac0-85c1-e0ecf0f7d0e7 admin admin] PATH_INFO: `/v3/projects/04d989a74aee4322b23df8d06f891728/users/246aec51c8c84011b72a6fcbbdb6502b/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.746276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0d9d8-9a97-4ac0-85c1-e0ecf0f7d0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d989a74aee4322b23df8d06f891728, user_id=246aec51c8c84011b72a6fcbbdb6502b, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.749001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0d9d8-9a97-4ac0-85c1-e0ecf0f7d0e7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.760326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 972/1947] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:38 2022] PUT /identity/v3/projects/04d989a74aee4322b23df8d06f891728/users/246aec51c8c84011b72a6fcbbdb6502b/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:38.771800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.772180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.772574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.777379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f5248-7a0c-4c4e-a103-a7ae63ffd39d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.802749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] MFA Rules not processed for user `246aec51c8c84011b72a6fcbbdb6502b`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:38.804009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.831084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.832529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.832907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.833473 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.887103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 973/1948] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:38.903503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:38.906075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:38.906329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.908517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:38.919912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 976/1949] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:38.974325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dc63b-6429-44f2-bd7a-61df4bc0fde4 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:38.978210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:38.978870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:38.979445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:38.979563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:38.989905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:38.991351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:39.002697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 974/1950] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:39.299768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:39.301207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:39.313759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d8c26-d24f-4526-85d0-46b3f3eeaec8 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:39.317544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:39.318197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:39.318481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:39.324236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:39.324236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:39.332875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:39.408082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:39.409584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:39.418663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 977/1951] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:39.518008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:39.519495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:39.534401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57597e-f417-4ea0-958a-34368b1c06cc service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:39.545749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:39.547281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:39.548186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:39.548632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] PATH_INFO: `/v3/projects/c0da5333f4e149e29d44592a4a479cf2` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:39.549999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0da5333f4e149e29d44592a4a479cf2)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:39.552692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:39.697319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0da5333f4e149e29d44592a4a479cf2', 'request_id': 'req-093b5957-ec94-4be8-9f43-e0546c5bd472'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:39.705045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0da5333f4e149e29d44592a4a479cf2', 'request_id': 'req-093b5957-ec94-4be8-9f43-e0546c5bd472'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:39.820643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0da5333f4e149e29d44592a4a479cf2', 'request_id': 'req-093b5957-ec94-4be8-9f43-e0546c5bd472'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:39.832584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] The token cache is being invalidate because project c0da5333f4e149e29d44592a4a479cf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:39.832883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:39.833526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-093b5957-ec94-4be8-9f43-e0546c5bd472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:39.835080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 975/1952] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:39 2022] DELETE /identity/v3/projects/c0da5333f4e149e29d44592a4a479cf2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:39.839267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:39.852878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f3f25-d964-400c-993d-4889b2ba1c3d service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:39.913107 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:39.914106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:39.914392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:39.914670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] PATH_INFO: `/v3/users/fb5c432e318a4edbba8260870cb9a144` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:39.915854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5c432e318a4edbba8260870cb9a144)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:39.918021 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:40.098176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5c432e318a4edbba8260870cb9a144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:40.211452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5c432e318a4edbba8260870cb9a144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:40.230946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5c432e318a4edbba8260870cb9a144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:40.244423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5c432e318a4edbba8260870cb9a144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:40.252139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d7ff8194-f190-4ae6-9f28-be787799cf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5c432e318a4edbba8260870cb9a144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:40.260486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 978/1953] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:39 2022] DELETE /identity/v3/users/fb5c432e318a4edbba8260870cb9a144 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:40.676613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:40.741825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:41.166343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:41.469742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e2fe2-393c-4a62-a87b-5bf61bdd6210 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:41.470307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e2fe2-393c-4a62-a87b-5bf61bdd6210 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:41.470823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e2fe2-393c-4a62-a87b-5bf61bdd6210 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:41.484253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 976/1954] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:54:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:54:41.488679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:41.489041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:41.489414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:41.519088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e2fe2-393c-4a62-a87b-5bf61bdd6210 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:41.519263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:41.520450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:41.522895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9e2e2fe2-393c-4a62-a87b-5bf61bdd6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:41.613572 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 979/1955] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:54:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:41.627281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:41.629975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:41.647350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809d45d-25ab-4c0e-9f11-870473b9a3c9 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:41.653831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:41.654497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:41.654762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:41.655045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:41.658785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e2fe2-393c-4a62-a87b-5bf61bdd6210 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:41.664282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:41.665220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:41.670504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:41.670504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:41.670504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] PATH_INFO: `/v3/projects/73ec5bdbca164b6db7fc0fdba0014a59` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:41.670762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:41.670873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ec5bdbca164b6db7fc0fdba0014a59)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:41.670873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:41.678981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 980/1956] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:41.799672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ec5bdbca164b6db7fc0fdba0014a59', 'request_id': 'req-9a85defd-a6f1-49e1-9911-28598dc3f8c3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:41.805852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ec5bdbca164b6db7fc0fdba0014a59', 'request_id': 'req-9a85defd-a6f1-49e1-9911-28598dc3f8c3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:41.897487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ec5bdbca164b6db7fc0fdba0014a59', 'request_id': 'req-9a85defd-a6f1-49e1-9911-28598dc3f8c3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:41.909559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] The token cache is being invalidate because project 73ec5bdbca164b6db7fc0fdba0014a59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:41.909856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:41.910511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:41.912167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 977/1957] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:41 2022] DELETE /identity/v3/projects/73ec5bdbca164b6db7fc0fdba0014a59 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:41.916144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:41.929804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e451-d105-496b-b5af-48be6cc97c9e service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:41.994387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:41.995301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:41.995432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:41.995607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:41.995891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] PATH_INFO: `/v3/users/433f74a8d0294710b2537f02a095befa` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:41.997164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=433f74a8d0294710b2537f02a095befa)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:41.997642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:42.009084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:42.018174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85defd-a6f1-49e1-9911-28598dc3f8c3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:42.025682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:42.026839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:42.027899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:42.027899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] PATH_INFO: `/v3/users/68ac3a701e9a4916b21c64d9a8d6e93e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:42.029597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ac3a701e9a4916b21c64d9a8d6e93e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:42.031840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:42.288934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ac3a701e9a4916b21c64d9a8d6e93e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.290242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '433f74a8d0294710b2537f02a095befa'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.399993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ac3a701e9a4916b21c64d9a8d6e93e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.415730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ac3a701e9a4916b21c64d9a8d6e93e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.423691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ac3a701e9a4916b21c64d9a8d6e93e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.424442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8cdc64f2-3d06-4e24-a557-00966f7a49bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ac3a701e9a4916b21c64d9a8d6e93e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.431127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 978/1958] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:41 2022] DELETE /identity/v3/users/68ac3a701e9a4916b21c64d9a8d6e93e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:42.435481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:42.435867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:42.436056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:42.463625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:42.463625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:42.514575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '433f74a8d0294710b2537f02a095befa'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.523117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 979/1959] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:42.530305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '433f74a8d0294710b2537f02a095befa'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.534592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:42.536181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:42.541308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '433f74a8d0294710b2537f02a095befa'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.542023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '433f74a8d0294710b2537f02a095befa'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:42.548197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 981/1960] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:41 2022] DELETE /identity/v3/users/433f74a8d0294710b2537f02a095befa => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:42.609281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e437d79-bde0-4b56-8939-75d50b69dece None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:42.676952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:42.677809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:42.678277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:42.678569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:42.680491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:42.753596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:42.755045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:42.775079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 980/1961] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:42.929825 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:43.110615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:43.112189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.123270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:43.125552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.127863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582fbd8-8fe4-433b-bb8a-c416dfc431c7 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:43.133530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:43.134718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.135257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.135694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] PATH_INFO: `/v3/users/56cfdc03ce6c47979aaa6e2dcfec7fbb` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.137236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cfdc03ce6c47979aaa6e2dcfec7fbb)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:43.139966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:43.154346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02696c6-0775-4b81-8fad-2cf9b47758f3 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:43.161471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:43.162471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.162842 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.163203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] PATH_INFO: `/v3/projects/96718b9612d04a4c9bdaa9e49fcc1c46` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.164692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] RBAC: Authorizing `identity:delete_project(project_id=96718b9612d04a4c9bdaa9e49fcc1c46)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:43.166829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:43.367973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cfdc03ce6c47979aaa6e2dcfec7fbb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.372095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96718b9612d04a4c9bdaa9e49fcc1c46', 'request_id': 'req-11710769-0cae-4e1f-ad5d-9e2d0396269a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.385078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96718b9612d04a4c9bdaa9e49fcc1c46', 'request_id': 'req-11710769-0cae-4e1f-ad5d-9e2d0396269a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.455744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cfdc03ce6c47979aaa6e2dcfec7fbb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.467964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cfdc03ce6c47979aaa6e2dcfec7fbb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.475631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cfdc03ce6c47979aaa6e2dcfec7fbb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.476280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cfdc03ce6c47979aaa6e2dcfec7fbb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.482343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 982/1962] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:43 2022] DELETE /identity/v3/users/56cfdc03ce6c47979aaa6e2dcfec7fbb => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:43.485643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:43.486580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.551745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e8c59-9412-4b99-8b04-7b4bb9a6252f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:43.556353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:43.557242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.557531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.557808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] PATH_INFO: `/v3/projects/34fb47f0e4134ed49a5c891b70aea29a` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.558981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fb47f0e4134ed49a5c891b70aea29a)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:43.560926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:43.620579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96718b9612d04a4c9bdaa9e49fcc1c46', 'request_id': 'req-11710769-0cae-4e1f-ad5d-9e2d0396269a'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.632777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] The token cache is being invalidate because project 96718b9612d04a4c9bdaa9e49fcc1c46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:43.633073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.633763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-11710769-0cae-4e1f-ad5d-9e2d0396269a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.635493 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 981/1963] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:43 2022] DELETE /identity/v3/projects/96718b9612d04a4c9bdaa9e49fcc1c46 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:43.636957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7277a-c341-4d09-a5cb-f3b849424b4a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.637249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7277a-c341-4d09-a5cb-f3b849424b4a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.637529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7277a-c341-4d09-a5cb-f3b849424b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.657796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-89a7277a-c341-4d09-a5cb-f3b849424b4a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:43.659019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-89a7277a-c341-4d09-a5cb-f3b849424b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.665947 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fb47f0e4134ed49a5c891b70aea29a', 'request_id': 'req-c477d3de-fef1-474e-a90c-e90e6def2628'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.672173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fb47f0e4134ed49a5c891b70aea29a', 'request_id': 'req-c477d3de-fef1-474e-a90c-e90e6def2628'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.736237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 982/1964] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:43.737750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.737924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.738232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.759184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:43.761058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.773784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 983/1965] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:43.774992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:43.776802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.788345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fb47f0e4134ed49a5c891b70aea29a', 'request_id': 'req-c477d3de-fef1-474e-a90c-e90e6def2628'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.792569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927431e2-b405-43ef-a0d5-5847d602a370 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:43.798523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:43.799516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.800510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.800662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] The token cache is being invalidate because project 34fb47f0e4134ed49a5c891b70aea29a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:43.800935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.801033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] PATH_INFO: `/v3/users/379bf4561f644b2cb027914ab26f8a45` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.801593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:43.802783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=379bf4561f644b2cb027914ab26f8a45)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:43.806417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 983/1966] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:43 2022] DELETE /identity/v3/projects/34fb47f0e4134ed49a5c891b70aea29a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:43.806417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:43.806417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.806689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:43.863682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:43.867372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477d3de-fef1-474e-a90c-e90e6def2628 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:43.871087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbf2f2-7607-462d-85d1-394d45008695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:43.871735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf2f2-7607-462d-85d1-394d45008695 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.872017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf2f2-7607-462d-85d1-394d45008695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.872293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbf2f2-7607-462d-85d1-394d45008695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.874275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-cdcbf2f2-7607-462d-85d1-394d45008695 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.887426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbf2f2-7607-462d-85d1-394d45008695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:43.888907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbf2f2-7607-462d-85d1-394d45008695 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:43.900935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 984/1967] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:43.902403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.902895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.903184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.923366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:43.926098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.934404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 985/1968] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:43.936996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:43.940358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:43.954911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7bd32-efa8-4a49-99ea-5b0caddd6a19 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:43.961365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:43.962072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:43.964052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:43.964052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] PATH_INFO: `/v3/users/381512122de8458693ef5a702f255c05` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:43.965713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=381512122de8458693ef5a702f255c05)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:43.967736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:43.973057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379bf4561f644b2cb027914ab26f8a45'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.089512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379bf4561f644b2cb027914ab26f8a45'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.104787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379bf4561f644b2cb027914ab26f8a45'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.112474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379bf4561f644b2cb027914ab26f8a45'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.113330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379bf4561f644b2cb027914ab26f8a45'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.120555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 984/1969] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:43 2022] DELETE /identity/v3/users/379bf4561f644b2cb027914ab26f8a45 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:44.121581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.124712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.199695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2be3db-e3c7-4b97-975b-bdf1bd14ef40 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.213882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381512122de8458693ef5a702f255c05'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.225717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f007495-dc93-4f00-b341-9688a02eac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.225717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f007495-dc93-4f00-b341-9688a02eac4d admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.225717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f007495-dc93-4f00-b341-9688a02eac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.225717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f007495-dc93-4f00-b341-9688a02eac4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.226497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f007495-dc93-4f00-b341-9688a02eac4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:44.226811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f007495-dc93-4f00-b341-9688a02eac4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.228936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f007495-dc93-4f00-b341-9688a02eac4d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.248453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 985/1970] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:44.251392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180fd2-9194-4df7-91c2-8b2483c878a1 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.251786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180fd2-9194-4df7-91c2-8b2483c878a1 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.252167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d180fd2-9194-4df7-91c2-8b2483c878a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.273488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3d180fd2-9194-4df7-91c2-8b2483c878a1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:44.281250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3d180fd2-9194-4df7-91c2-8b2483c878a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.283369 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 986/1971] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:44.284282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d180fd2-9194-4df7-91c2-8b2483c878a1 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.294059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d180fd2-9194-4df7-91c2-8b2483c878a1 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.300691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.301504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.301895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.302270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.303078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.305175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.331896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381512122de8458693ef5a702f255c05'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.347384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381512122de8458693ef5a702f255c05'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.354675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381512122de8458693ef5a702f255c05'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.355414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381512122de8458693ef5a702f255c05'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.362714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 986/1972] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:43 2022] DELETE /identity/v3/users/381512122de8458693ef5a702f255c05 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:44.365853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.365853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.442516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0ef1b-666a-418d-bb9e-6818ef31b80b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.446544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.447330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.447720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.448137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.451406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.462127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 987/1973] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:44 2022] POST /identity/v3/projects => generated 409 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:44.466279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.471341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.604075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed65cd-637f-4e90-a1d4-7d952cd8c1ed admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.610808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.620579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.620579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.620782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.620782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.620782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.620782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.621103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.628468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 987/1974] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:44.629474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.630800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.644618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770023c3-0e64-4cf1-a029-d31979c42567 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.651262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.652132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.652439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.652722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] PATH_INFO: `/v3/projects/76ed0a6ca51b4eacb4761fa2a08388be` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.653961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ed0a6ca51b4eacb4761fa2a08388be)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.655829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.728926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 988/1975] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:44 2022] POST /identity/v3/users => generated 305 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:44.730471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.741968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504869cb-7e69-4fb2-9dd7-e0f6d82759c3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.753201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.753845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.754090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.754375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.755114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.756816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.768766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 989/1976] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:44.773048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.784962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ed0a6ca51b4eacb4761fa2a08388be', 'request_id': 'req-8c310550-5203-41c6-99bc-eb6f3c3ef06a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.785718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf6c05-7879-4bd8-bf74-0ab74d112383 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.791357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ed0a6ca51b4eacb4761fa2a08388be', 'request_id': 'req-8c310550-5203-41c6-99bc-eb6f3c3ef06a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.847625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.848352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.848637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.848972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.849710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.851320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.862316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 990/1977] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:44.867225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.878597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccabcd1-5aee-4b60-8b7d-04892fc88c03 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:44.886590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:44.887565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.887565 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.887816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] PATH_INFO: `/v3/projects/2c7d551dcd1648d78b93801a192aa29b/users/6073bcab1c7e425d826a369100676057/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.895537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ed0a6ca51b4eacb4761fa2a08388be', 'request_id': 'req-8c310550-5203-41c6-99bc-eb6f3c3ef06a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.909340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c7d551dcd1648d78b93801a192aa29b, user_id=6073bcab1c7e425d826a369100676057, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:44.910648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] The token cache is being invalidate because project 76ed0a6ca51b4eacb4761fa2a08388be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:44.910944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.911860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c310550-5203-41c6-99bc-eb6f3c3ef06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:44.912058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:44.913577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 988/1978] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:44 2022] DELETE /identity/v3/projects/76ed0a6ca51b4eacb4761fa2a08388be => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:44.923347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e83b-3765-4a6d-8d9e-f881b105d71b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.923347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e83b-3765-4a6d-8d9e-f881b105d71b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.923347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e83b-3765-4a6d-8d9e-f881b105d71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.940723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8c78e83b-3765-4a6d-8d9e-f881b105d71b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:44.942007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8c78e83b-3765-4a6d-8d9e-f881b105d71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.950655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 989/1979] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:44.958810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:44.959109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:44.962605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:44.978423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:44.979813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:44.989326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 990/1980] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:44.994235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:44.995566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.011270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 991/1981] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:44 2022] PUT /identity/v3/projects/2c7d551dcd1648d78b93801a192aa29b/users/6073bcab1c7e425d826a369100676057/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:45.011891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4073617-9742-41f7-8e57-df52dcd499c8 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.023681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:45.069448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.070352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.070641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.070922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] PATH_INFO: `/v3/projects/29e931ae5138418d810091c26599153c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.072173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e931ae5138418d810091c26599153c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.074208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:45.078084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b88b8-2d33-47e1-b329-dfde92f19b97 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.083815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b129b6a-282c-4c75-b462-7e1dacfa00fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.084509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b129b6a-282c-4c75-b462-7e1dacfa00fa admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.084797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b129b6a-282c-4c75-b462-7e1dacfa00fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.085317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b129b6a-282c-4c75-b462-7e1dacfa00fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.085840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b129b6a-282c-4c75-b462-7e1dacfa00fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:45.086147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b129b6a-282c-4c75-b462-7e1dacfa00fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.087754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b129b6a-282c-4c75-b462-7e1dacfa00fa admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:45.100677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 992/1982] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:45.101998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.102302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.102591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.135949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] MFA Rules not processed for user `6073bcab1c7e425d826a369100676057`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:45.137203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.216983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 993/1983] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:45.217866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:45.219760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.225690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e931ae5138418d810091c26599153c', 'request_id': 'req-53676ec5-3c98-43f2-a46e-87125feab91a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.235370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e931ae5138418d810091c26599153c', 'request_id': 'req-53676ec5-3c98-43f2-a46e-87125feab91a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.238167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d356188-beee-4eeb-90e1-26f0dc269f3a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.305668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.306538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.306821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.307100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] PATH_INFO: `/v3/projects/219520a0d6ba4396b95ddf5914b8fc25` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.308460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=219520a0d6ba4396b95ddf5914b8fc25)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.310376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:45.342997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e931ae5138418d810091c26599153c', 'request_id': 'req-53676ec5-3c98-43f2-a46e-87125feab91a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.355341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] The token cache is being invalidate because project 29e931ae5138418d810091c26599153c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:45.355636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.356327 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.357948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 991/1984] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:44 2022] DELETE /identity/v3/projects/29e931ae5138418d810091c26599153c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:45.363986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:45.365351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.377643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53676ec5-3c98-43f2-a46e-87125feab91a admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.382289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.382941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.383233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.383518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.384209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.386239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:45.475385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:45.487867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 992/1985] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:45 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:45.487867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:45.487867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.513172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219520a0d6ba4396b95ddf5914b8fc25', 'request_id': 'req-3917bc14-ce37-493f-b596-75f002639a74'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.521377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219520a0d6ba4396b95ddf5914b8fc25', 'request_id': 'req-3917bc14-ce37-493f-b596-75f002639a74'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.580649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783fb30-82e8-41fc-acbd-6e895af398c4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.589052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219520a0d6ba4396b95ddf5914b8fc25', 'request_id': 'req-3917bc14-ce37-493f-b596-75f002639a74'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.611270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] The token cache is being invalidate because project 219520a0d6ba4396b95ddf5914b8fc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:45.611620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.616044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3917bc14-ce37-493f-b596-75f002639a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:45.622581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 994/1986] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:45 2022] DELETE /identity/v3/projects/219520a0d6ba4396b95ddf5914b8fc25 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:45.622581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.622966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.623191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.659829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.660612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.660915 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.661200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.662223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.663951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:45.682574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:45.684441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.697792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 995/1987] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:45.699181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:45.700997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.720694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3ffc0-5047-4fef-96dc-320348aceda7 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.726752 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15779b4c-e0a4-4d16-9659-3185c54000f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.727885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15779b4c-e0a4-4d16-9659-3185c54000f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.728393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15779b4c-e0a4-4d16-9659-3185c54000f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.728937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15779b4c-e0a4-4d16-9659-3185c54000f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.729943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15779b4c-e0a4-4d16-9659-3185c54000f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.732244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15779b4c-e0a4-4d16-9659-3185c54000f2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:45.767804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 993/1988] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:45 2022] POST /identity/v3/projects => generated 407 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:45.771426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:45.773100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.853778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 996/1989] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:45 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:45.853778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.853778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.853778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.862713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e9e6d-4739-44c5-bfa8-2375c12f024c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.869306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:45.870773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.873620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.874854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.876208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.876577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] PATH_INFO: `/v3/users/246aec51c8c84011b72a6fcbbdb6502b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.880364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246aec51c8c84011b72a6fcbbdb6502b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.880709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 997/1990] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:45.881721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:45.883283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:45.889434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:45.897585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2bbc2-f182-49bb-b5b8-d55eb663dbb1 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:45.903523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:45.912485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:45.912485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:45.912485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:45.912485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:45.912485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.098504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 998/1991] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:45 2022] POST /identity/v3/users => generated 310 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:46.098504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.107784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385a8edd-7493-450a-8070-6e589217b9e5 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.112455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.113110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.113391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.113671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.114410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.116019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.126286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 999/1992] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:46.127048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.136077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af584d-adf0-40f0-b96b-2c536705261a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.141343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.141917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.142198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.142478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.143201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:46.143507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.145075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.156518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1000/1993] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:46.157283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.158884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.170765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbe3d4-145a-4dc0-aefe-6c3a111193f2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.176112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.176980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.177288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.177564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] PATH_INFO: `/v3/users/8cb7464839124b40867717825c384be4` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.178734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb7464839124b40867717825c384be4)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.180620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.214790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246aec51c8c84011b72a6fcbbdb6502b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.234829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:46.326313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246aec51c8c84011b72a6fcbbdb6502b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.339425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246aec51c8c84011b72a6fcbbdb6502b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.346891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246aec51c8c84011b72a6fcbbdb6502b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.347609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246aec51c8c84011b72a6fcbbdb6502b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.353759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 994/1994] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:45 2022] DELETE /identity/v3/users/246aec51c8c84011b72a6fcbbdb6502b => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:46.354573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.357816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.424338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb7464839124b40867717825c384be4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.436268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b536a5e-233a-4fc1-9c93-db84dfd241e9 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.442187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.443007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.443380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.443717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.444653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.446370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.458429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 995/1995] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:46.459388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.461863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.475335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cf50-47fd-44b7-a1c9-0a6d12839f33 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.480500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.481169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.481458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.481737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.482451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.484043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.491390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb7464839124b40867717825c384be4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.494907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 996/1996] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:46.497650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.500820 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.508176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb7464839124b40867717825c384be4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.514609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48247b9-8eb3-4f3e-b3c7-83afd4b38c09 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.515260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb7464839124b40867717825c384be4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.516081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb7464839124b40867717825c384be4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:46.520987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.521717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.522081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.522422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1001/1997] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:46 2022] DELETE /identity/v3/users/8cb7464839124b40867717825c384be4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:46.522525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.523292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.523421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.524673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.525365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.618566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a55bd-77fc-4859-8804-4a02acc2bd19 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.623386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebb73a-7860-4429-94d9-4597b4d513cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.624703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb73a-7860-4429-94d9-4597b4d513cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.625889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb73a-7860-4429-94d9-4597b4d513cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.626376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebb73a-7860-4429-94d9-4597b4d513cf admin admin] PATH_INFO: `/v3/projects/ebadd3aaafcc484d9635d6d06c4e6ac5/users/a154b48791df4999a6029dd3a1027b7b/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.642611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebb73a-7860-4429-94d9-4597b4d513cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebadd3aaafcc484d9635d6d06c4e6ac5, user_id=a154b48791df4999a6029dd3a1027b7b, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.645588 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 997/1998] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:46 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:46.646117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ebb73a-7860-4429-94d9-4597b4d513cf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.646785 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.649957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.721580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bae6e8-b7eb-493a-9428-0e452102d1d8 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.736274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1002/1999] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:46 2022] PUT /identity/v3/projects/ebadd3aaafcc484d9635d6d06c4e6ac5/users/a154b48791df4999a6029dd3a1027b7b/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:46.738155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.738791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.739005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.740214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.740516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.740869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.741819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] PATH_INFO: `/v3/projects/e4c1b90d847449679548713b5dbfe80c/users/64fa95c8802141a8bda4f72a4197938d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.768310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:46.770531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c1b90d847449679548713b5dbfe80c, user_id=64fa95c8802141a8bda4f72a4197938d, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.773493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.780851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:46.782937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.842104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1003/2000] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:46.842848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.844717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:46.856562 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2ebef-fb6f-470e-add1-4fcd434098b8 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.862333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.863005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.863298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.863599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.864300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.866412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.884941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 998/2001] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:46 2022] PUT /identity/v3/projects/e4c1b90d847449679548713b5dbfe80c/users/64fa95c8802141a8bda4f72a4197938d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:46.886551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.959731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc142708-7a62-4c49-b30b-ae5d669544f2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:46.964298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:46.965010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:46.965305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:46.965589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:46.966330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:46.968180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:46.980913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 999/2002] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:46.982050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:46.983741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.018268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1004/2003] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:46 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:47.019121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.021553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.034250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d6b9d6-7a67-46f6-aa27-14fc6b3d4d44 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.040263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.042074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.042371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.042654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] PATH_INFO: `/v3/projects/04d989a74aee4322b23df8d06f891728` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.044053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d989a74aee4322b23df8d06f891728)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.047116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.048552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d0046-0af2-4243-969e-dacf5e109814 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.052503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9831d98-fdce-4bbd-bae4-07ccc525c8b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.053159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831d98-fdce-4bbd-bae4-07ccc525c8b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.053449 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831d98-fdce-4bbd-bae4-07ccc525c8b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.053730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9831d98-fdce-4bbd-bae4-07ccc525c8b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.067472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9831d98-fdce-4bbd-bae4-07ccc525c8b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.068992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9831d98-fdce-4bbd-bae4-07ccc525c8b0 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.081360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1000/2004] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:47.082544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb4fe-a8b3-41f1-b8aa-490bd984b999 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.082838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb4fe-a8b3-41f1-b8aa-490bd984b999 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.083131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecb4fe-a8b3-41f1-b8aa-490bd984b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.110997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2aecb4fe-a8b3-41f1-b8aa-490bd984b999 None None] MFA Rules not processed for user `64fa95c8802141a8bda4f72a4197938d`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:47.112464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2aecb4fe-a8b3-41f1-b8aa-490bd984b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.175801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d989a74aee4322b23df8d06f891728', 'request_id': 'req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:47.188151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d989a74aee4322b23df8d06f891728', 'request_id': 'req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:47.219906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1001/2005] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:47.219906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb4fe-a8b3-41f1-b8aa-490bd984b999 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.231019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecb4fe-a8b3-41f1-b8aa-490bd984b999 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.269506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d989a74aee4322b23df8d06f891728', 'request_id': 'req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:47.289171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] The token cache is being invalidate because project 04d989a74aee4322b23df8d06f891728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:47.290024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:47.292678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:47.308506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1005/2006] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:47 2022] DELETE /identity/v3/projects/04d989a74aee4322b23df8d06f891728 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:47.309815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.314172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.377176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.378574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.378868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.379894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] PATH_INFO: `/v3/projects/ebadd3aaafcc484d9635d6d06c4e6ac5/users/a154b48791df4999a6029dd3a1027b7b/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.383606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebadd3aaafcc484d9635d6d06c4e6ac5, user_id=a154b48791df4999a6029dd3a1027b7b, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.386931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.409351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1002/2007] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:47 2022] PUT /identity/v3/projects/ebadd3aaafcc484d9635d6d06c4e6ac5/users/a154b48791df4999a6029dd3a1027b7b/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:47.409351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.412350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.431791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fd5cf-53a3-4d2b-ad24-c8d90016ae67 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.510441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef38b169-86ac-46f5-b28f-986e318cf574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.512104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b169-86ac-46f5-b28f-986e318cf574 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.512615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b169-86ac-46f5-b28f-986e318cf574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.513692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef38b169-86ac-46f5-b28f-986e318cf574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.514693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38b169-86ac-46f5-b28f-986e318cf574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.515162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95c6f3-6c10-4487-afb5-b03c1715b7ea admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.518445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef38b169-86ac-46f5-b28f-986e318cf574 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.520591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.521260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.521920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.522450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.524843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.540463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1006/2008] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:47.543367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ff7c-1ff9-486d-83b0-0cd90e388dbc None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.543900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ff7c-1ff9-486d-83b0-0cd90e388dbc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.544392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6ff7c-1ff9-486d-83b0-0cd90e388dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.572645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9bc6ff7c-1ff9-486d-83b0-0cd90e388dbc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:47.582419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9bc6ff7c-1ff9-486d-83b0-0cd90e388dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.590001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1007/2009] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:47.591847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.592630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.593264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.627554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] MFA Rules not processed for user `a154b48791df4999a6029dd3a1027b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:47.629123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.653562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.655574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.669157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1003/2010] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:47.670309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.682365 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5103535e-98b1-426d-b0b0-d928d7a8471f service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.689465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce5ad1e-fd61-4604-bc91-01fdf3aa308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.690603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ad1e-fd61-4604-bc91-01fdf3aa308d admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.690990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ad1e-fd61-4604-bc91-01fdf3aa308d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.691342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce5ad1e-fd61-4604-bc91-01fdf3aa308d admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.692159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5ad1e-fd61-4604-bc91-01fdf3aa308d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.693893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce5ad1e-fd61-4604-bc91-01fdf3aa308d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.719601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1004/2011] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:47.725023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115ff1-319d-4b66-a840-50493e48e63e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.725023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115ff1-319d-4b66-a840-50493e48e63e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.725023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f115ff1-319d-4b66-a840-50493e48e63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.743887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1008/2012] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:47.753534 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.753534 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.766432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2f115ff1-319d-4b66-a840-50493e48e63e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:47.768353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2f115ff1-319d-4b66-a840-50493e48e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.771720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9aaf1-1347-40c0-8596-7306b32b0365 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.778622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1005/2013] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:47.778622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115ff1-319d-4b66-a840-50493e48e63e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.785264 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.786428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.786837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.787339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] PATH_INFO: `/v3/users/64fa95c8802141a8bda4f72a4197938d` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.788759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=64fa95c8802141a8bda4f72a4197938d)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.790388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f115ff1-319d-4b66-a840-50493e48e63e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.791127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.795248 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.796158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.796790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.797532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] PATH_INFO: `/v3/projects/a1ec3ef23473420c8f1e5d432d441150/users/0c13b5b0f561481bb487a63363a9c116/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:47.814175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ec3ef23473420c8f1e5d432d441150, user_id=0c13b5b0f561481bb487a63363a9c116, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:47.817144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:47.828810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:47.914143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1006/2014] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:47 2022] PUT /identity/v3/projects/a1ec3ef23473420c8f1e5d432d441150/users/0c13b5b0f561481bb487a63363a9c116/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:47.914990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:47.916873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:47.981667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a5c9f9-1485-4a29-9945-47da7ef096cc admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:47.985943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:47.986593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:47.986874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:47.987184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.039314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:48.053905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.055363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.066260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1007/2015] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:47 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:48.067076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.083355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64fa95c8802141a8bda4f72a4197938d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.139531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc81dd1-22a8-4501-bf2c-7f5c92f0fa51 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.141628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119691e-f918-415f-93c1-494dad5b216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.142367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119691e-f918-415f-93c1-494dad5b216d admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.142722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119691e-f918-415f-93c1-494dad5b216d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.143067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119691e-f918-415f-93c1-494dad5b216d admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.143867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119691e-f918-415f-93c1-494dad5b216d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:48.144320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119691e-f918-415f-93c1-494dad5b216d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.145990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119691e-f918-415f-93c1-494dad5b216d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.158109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1008/2016] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:48.159384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.159677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.159957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.164120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64fa95c8802141a8bda4f72a4197938d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.179001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64fa95c8802141a8bda4f72a4197938d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.185937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64fa95c8802141a8bda4f72a4197938d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.186646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64fa95c8802141a8bda4f72a4197938d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.190407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] MFA Rules not processed for user `0c13b5b0f561481bb487a63363a9c116`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:48.191641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.193454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1009/2017] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:47 2022] DELETE /identity/v3/users/64fa95c8802141a8bda4f72a4197938d => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:48.194575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.195988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.279508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1009/2018] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:48.280167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6fea5-bb5f-40fb-a564-2b8a621dcfcf admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.285535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.287101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.288789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.289680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.289976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.290260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] PATH_INFO: `/v3/projects/805abe0e77a7427ba313cf7532efd7f2` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.291501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=805abe0e77a7427ba313cf7532efd7f2)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.295066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.307709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f93a40-a048-4cd1-bde5-d4cd8f89e2de None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.313405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767b117-0398-4995-ab94-4f3eb00cf193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.314086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b117-0398-4995-ab94-4f3eb00cf193 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.314524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b117-0398-4995-ab94-4f3eb00cf193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.315235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767b117-0398-4995-ab94-4f3eb00cf193 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.315937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767b117-0398-4995-ab94-4f3eb00cf193 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.317952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767b117-0398-4995-ab94-4f3eb00cf193 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.430670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1010/2019] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:48 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:48.431600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.432390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.432390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.454229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:48.455766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.465996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '805abe0e77a7427ba313cf7532efd7f2', 'request_id': 'req-687b2aa3-a397-4bff-ae17-7ea130750d15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.474294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '805abe0e77a7427ba313cf7532efd7f2', 'request_id': 'req-687b2aa3-a397-4bff-ae17-7ea130750d15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.539319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1011/2020] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:48.540167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.541406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '805abe0e77a7427ba313cf7532efd7f2', 'request_id': 'req-687b2aa3-a397-4bff-ae17-7ea130750d15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.541584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.554233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090460e-ad3c-4800-9147-886e69cd5865 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.556606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] The token cache is being invalidate because project 805abe0e77a7427ba313cf7532efd7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:48.556897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.557657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:48.559093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.561029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1010/2021] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:48 2022] DELETE /identity/v3/projects/805abe0e77a7427ba313cf7532efd7f2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:48.561169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.561169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.561169 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.561391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.561464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.564152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.564741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.578452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b2aa3-a397-4bff-ae17-7ea130750d15 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.583914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.584633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.584905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.585190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.585900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.588004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.681396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1011/2022] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:48 2022] POST /identity/v3/users => generated 286 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:48.681578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1012/2023] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:48 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:48.681697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.681789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.681877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.683004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.742048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82860123-76ce-4dcc-8699-8fda8e9dbb50 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.743847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b0e0a6-7844-4ae0-8d50-03673e44582b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.745815 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.746466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.746758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.747040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.751987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.802305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.803343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.803825 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.804294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.807952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.826202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.828025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.839255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1013/2024] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:48.840631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.842413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.859019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad42d9d-bb76-4900-a3f5-e25dbe87134b service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.868062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.869961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.870317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.871298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] PATH_INFO: `/v3/users/5b6a4973dd324c3b86555ad674bc0a6b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.874016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b6a4973dd324c3b86555ad674bc0a6b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.878718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.895862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.898063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:48.914649 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1012/2025] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:48.915845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:48.918067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:48.934872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56a626-9811-4ff6-837d-75eafda4e469 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:48.941463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:48.942268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:48.942657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:48.943036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:48.943834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:48.945964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.046433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:49.059144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1013/2026] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:48 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:49.060769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.073933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4181c8-7551-40c5-99fe-639be5149fe2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.089838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.090524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b6a4973dd324c3b86555ad674bc0a6b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.091352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.092719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.093024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.094245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.096946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.113411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1014/2027] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:49.117217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.128897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d0c10-1df9-40c7-999a-9fc532906ca7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.134217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.135105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.135446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.135677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.136542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.138147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.150959 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1015/2028] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:49.151944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.162452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031abfbc-2b9d-411d-9afe-51ca7d706657 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.167474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.168348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.168762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.169142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.169979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.171643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.185696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1016/2029] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:49.188234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.199681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162f351-e520-4712-b2a9-cf80f51a9572 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.202197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:49.209673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.209673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.209673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.209673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] PATH_INFO: `/v3/projects/f0b13dbef59a4974b39ee5c1b169e81a/users/a6362c81681c4861a9e57b490512e3f3/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.210033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b6a4973dd324c3b86555ad674bc0a6b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.223084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b6a4973dd324c3b86555ad674bc0a6b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.225110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b13dbef59a4974b39ee5c1b169e81a, user_id=a6362c81681c4861a9e57b490512e3f3, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.227958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.230579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b6a4973dd324c3b86555ad674bc0a6b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.231270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b6a4973dd324c3b86555ad674bc0a6b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.238268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1014/2030] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:54:48 2022] DELETE /identity/v3/users/5b6a4973dd324c3b86555ad674bc0a6b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:49.239202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.240627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:49.315802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c5138-a04b-448f-b1eb-b06f4e785983 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.322369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.323231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.323524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.323806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] PATH_INFO: `/v3/projects/916f67361ebf4aa7afbfad991a853a7c/users/bc199810e9d04a5b87de196d3ff089f7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.341979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916f67361ebf4aa7afbfad991a853a7c, user_id=bc199810e9d04a5b87de196d3ff089f7, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.345222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.352762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1017/2031] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:49 2022] PUT /identity/v3/projects/f0b13dbef59a4974b39ee5c1b169e81a/users/a6362c81681c4861a9e57b490512e3f3/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:49.352762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.353620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:49.419197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec9d2a-b35e-40e1-9e74-dcd11f416907 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.425120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.426069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.426356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.426631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] PATH_INFO: `/v3/projects/e4c1b90d847449679548713b5dbfe80c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.431325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1015/2032] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:49 2022] PUT /identity/v3/projects/916f67361ebf4aa7afbfad991a853a7c/users/bc199810e9d04a5b87de196d3ff089f7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:49.431490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c1b90d847449679548713b5dbfe80c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.431578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.431667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.431743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:49.511508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af45b7d-158a-47a3-ba92-05576a9be1c0 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.517790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c86e-e385-4795-bd83-360dbc74586e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.519171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c86e-e385-4795-bd83-360dbc74586e admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.519469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c86e-e385-4795-bd83-360dbc74586e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.520517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c86e-e385-4795-bd83-360dbc74586e admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.521054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385c86e-e385-4795-bd83-360dbc74586e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.524455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385c86e-e385-4795-bd83-360dbc74586e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.534149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1016/2033] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:49.535766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffda30-e893-44d1-9bf0-510009b5427f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.536673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffda30-e893-44d1-9bf0-510009b5427f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.537261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffda30-e893-44d1-9bf0-510009b5427f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.556181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-1fffda30-e893-44d1-9bf0-510009b5427f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:49.557466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1fffda30-e893-44d1-9bf0-510009b5427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:49.567061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1017/2034] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:49.567868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffda30-e893-44d1-9bf0-510009b5427f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.578212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffda30-e893-44d1-9bf0-510009b5427f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.588372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c1b90d847449679548713b5dbfe80c', 'request_id': 'req-575d7966-3c0e-449c-9353-92c33b3b57fa'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.595526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c1b90d847449679548713b5dbfe80c', 'request_id': 'req-575d7966-3c0e-449c-9353-92c33b3b57fa'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.669644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c1b90d847449679548713b5dbfe80c', 'request_id': 'req-575d7966-3c0e-449c-9353-92c33b3b57fa'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.675494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.676765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.677058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.677731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] PATH_INFO: `/v3/projects/f0b13dbef59a4974b39ee5c1b169e81a/users/a6362c81681c4861a9e57b490512e3f3/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.689738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b13dbef59a4974b39ee5c1b169e81a, user_id=a6362c81681c4861a9e57b490512e3f3, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.692103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.727794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1018/2035] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:49 2022] PUT /identity/v3/projects/f0b13dbef59a4974b39ee5c1b169e81a/users/a6362c81681c4861a9e57b490512e3f3/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:49.727794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:49.731093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:49.741148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] The token cache is being invalidate because project e4c1b90d847449679548713b5dbfe80c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:49.741397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.745131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-575d7966-3c0e-449c-9353-92c33b3b57fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:49.751663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1018/2036] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:49 2022] DELETE /identity/v3/projects/e4c1b90d847449679548713b5dbfe80c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:49.752099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.752510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.765876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.804194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] MFA Rules not processed for user `a6362c81681c4861a9e57b490512e3f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:49.805594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:49.835907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d7d7a5-445a-412e-9c12-7b31f6eff5e5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:49.841660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059f2ed2-72c0-4200-83db-518a4fc6b27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:49.842107 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2ed2-72c0-4200-83db-518a4fc6b27b service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:49.842494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2ed2-72c0-4200-83db-518a4fc6b27b service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:49.842901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059f2ed2-72c0-4200-83db-518a4fc6b27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:49.845252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-059f2ed2-72c0-4200-83db-518a4fc6b27b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:49.980293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f2ed2-72c0-4200-83db-518a4fc6b27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:49.982471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059f2ed2-72c0-4200-83db-518a4fc6b27b service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:49.997783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1019/2037] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:50.012278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.013069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.016452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.019638 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1019/2038] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:50.020759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.022142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.048950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a82c7-cf7d-452c-92d7-8161c7a731ba None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.053659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.054393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:50.054533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.054834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.055120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] PATH_INFO: `/v3/projects/c554257d23644a1e8f4746c48df301a5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.055633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.056434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c554257d23644a1e8f4746c48df301a5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.058496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.064717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1020/2039] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:50.065525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.066829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.124390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8597880-7939-4ff7-ae72-87f41092c733 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.128733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62dad64-fd73-4738-9d6c-eaff703411d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.129379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dad64-fd73-4738-9d6c-eaff703411d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.129663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dad64-fd73-4738-9d6c-eaff703411d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.129941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62dad64-fd73-4738-9d6c-eaff703411d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.131739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f62dad64-fd73-4738-9d6c-eaff703411d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.205486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dad64-fd73-4738-9d6c-eaff703411d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.207234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62dad64-fd73-4738-9d6c-eaff703411d7 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.213051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c554257d23644a1e8f4746c48df301a5', 'request_id': 'req-d46b6cf8-08cc-46e8-a13c-41381cc24110'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:50.218412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1021/2040] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:50.221073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f92c5-5dea-4558-8a6a-6335c3ab403d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.221369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f92c5-5dea-4558-8a6a-6335c3ab403d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.221650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f92c5-5dea-4558-8a6a-6335c3ab403d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.222951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c554257d23644a1e8f4746c48df301a5', 'request_id': 'req-d46b6cf8-08cc-46e8-a13c-41381cc24110'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:50.249859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-147f92c5-5dea-4558-8a6a-6335c3ab403d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:50.253679 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-147f92c5-5dea-4558-8a6a-6335c3ab403d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.321566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1022/2041] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:50.323285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c554257d23644a1e8f4746c48df301a5', 'request_id': 'req-d46b6cf8-08cc-46e8-a13c-41381cc24110'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:50.339041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f92c5-5dea-4558-8a6a-6335c3ab403d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.339307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] The token cache is being invalidate because project c554257d23644a1e8f4746c48df301a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:54:50.339307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:50.339810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d46b6cf8-08cc-46e8-a13c-41381cc24110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:54:50.344453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1020/2042] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:54:50 2022] DELETE /identity/v3/projects/c554257d23644a1e8f4746c48df301a5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:50.347591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53d55-2d88-45bb-938d-bdeb5d7315b1 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.347894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53d55-2d88-45bb-938d-bdeb5d7315b1 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.348180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d53d55-2d88-45bb-938d-bdeb5d7315b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.348281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f92c5-5dea-4558-8a6a-6335c3ab403d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.362978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.362978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.362978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.362978 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.368610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:50.368610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.368610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.369953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:50.374428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-48d53d55-2d88-45bb-938d-bdeb5d7315b1 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:50.376766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-48d53d55-2d88-45bb-938d-bdeb5d7315b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.384392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1023/2043] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:54:50.389637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.393515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1021/2044] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:50.404522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.411469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c6f99-4446-4b6c-851a-5293c3496c7f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.412096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c6f99-4446-4b6c-851a-5293c3496c7f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.412650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c6f99-4446-4b6c-851a-5293c3496c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.413409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28584e-05cb-45ba-9e36-11eac3402131 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.418148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.418736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.419030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.419315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.420196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.423292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.439471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e43c6f99-4446-4b6c-851a-5293c3496c7f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:50.440712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e43c6f99-4446-4b6c-851a-5293c3496c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:50.448678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1022/2045] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:50.452188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:50.453088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c6f99-4446-4b6c-851a-5293c3496c7f None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.462608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c6f99-4446-4b6c-851a-5293c3496c7f None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.467666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.468337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.469461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.469578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.470238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:54:50.470549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.472157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.488585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1023/2046] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:54:50.490265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.501150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0eb2b-121d-485b-81d1-057698532aa9 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.506698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.507368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.507661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.507944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.508699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.510664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.528447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1024/2047] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:50.532617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.593492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca914a-39ad-4c43-ab3f-263ea8613a1c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.599185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.599861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.600153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.600462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.601330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.604371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.617625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1024/2048] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:50.619855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.689247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89aa06-143a-4e98-893d-1d724164f3c0 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.693915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.694583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.694869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.695145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.696884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.698973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.737886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1025/2049] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:50.742005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.758751 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b9242-c369-4974-ad07-2ab8e33b108e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.763689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.764383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.764741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.764996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.766266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.768061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.782085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1026/2050] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:50.783229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.793047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b0333-2977-4238-87f6-5190be8256fa admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.797932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.798590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.798881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.799165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.799892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.801952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.815173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1027/2051] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:50.825574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.836229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8668f2a-98b1-4228-8d01-2b645ecbdecd admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.841809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f8c57-c1fe-47a0-8478-09f7abe197d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.842689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8c57-c1fe-47a0-8478-09f7abe197d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.842976 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8c57-c1fe-47a0-8478-09f7abe197d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.843561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f8c57-c1fe-47a0-8478-09f7abe197d6 admin admin] PATH_INFO: `/v3/projects/0d6b4382cb104dde8ef340d6cf4f3037/users/65aafb8e5b564f6894cb49f2de27d4d0/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.856894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1025/2052] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:50 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:50.861240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8c57-c1fe-47a0-8478-09f7abe197d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6b4382cb104dde8ef340d6cf4f3037, user_id=65aafb8e5b564f6894cb49f2de27d4d0, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.863927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f8c57-c1fe-47a0-8478-09f7abe197d6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.864972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.874700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c1a73-614b-42d2-bd24-a1ac49d9cfe5 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.879478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.880124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.880426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.880720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.881437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.883010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.894277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1026/2053] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:50.902472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.911675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb05f8-2b97-4ce9-92fe-f0295422a399 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.919334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.920075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.920648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.921157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.922500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.925462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:50.938764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1027/2054] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:50.943545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:50.953983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fd0fb-4f87-4797-992c-7127f03389ba admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:50.958703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca123cdb-867a-4326-9632-ce1159e627bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:50.959586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123cdb-867a-4326-9632-ce1159e627bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:50.959873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123cdb-867a-4326-9632-ce1159e627bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:50.960189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca123cdb-867a-4326-9632-ce1159e627bb admin admin] PATH_INFO: `/v3/projects/ef45b613caee410da5a0e5f091da186f/users/37b6a241b83445a3ad2361210d223677/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:50.978003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca123cdb-867a-4326-9632-ce1159e627bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef45b613caee410da5a0e5f091da186f, user_id=37b6a241b83445a3ad2361210d223677, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:50.980715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca123cdb-867a-4326-9632-ce1159e627bb admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:51.029952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1028/2055] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:50 2022] PUT /identity/v3/projects/0d6b4382cb104dde8ef340d6cf4f3037/users/65aafb8e5b564f6894cb49f2de27d4d0/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:51.032333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.032752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.033043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.092964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1028/2056] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:50 2022] PUT /identity/v3/projects/ef45b613caee410da5a0e5f091da186f/users/37b6a241b83445a3ad2361210d223677/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:51.105139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6385f-28ab-447b-baaa-67c7fe5a70a2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.105836 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6385f-28ab-447b-baaa-67c7fe5a70a2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.106294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6385f-28ab-447b-baaa-67c7fe5a70a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.108263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] MFA Rules not processed for user `65aafb8e5b564f6894cb49f2de27d4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:51.109917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:51.157424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-cdf6385f-28ab-447b-baaa-67c7fe5a70a2 None None] MFA Rules not processed for user `37b6a241b83445a3ad2361210d223677`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:51.160022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-cdf6385f-28ab-447b-baaa-67c7fe5a70a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:51.197849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1029/2057] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:51.211144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:51.212760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:51.272778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1029/2058] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:51.278951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6385f-28ab-447b-baaa-67c7fe5a70a2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:51.299796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbd629-139a-4d05-8211-18f692254e03 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:51.304858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:51.305532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.305829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.306120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.316163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:51.325307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:51.341570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1030/2059] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:51.412004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf6385f-28ab-447b-baaa-67c7fe5a70a2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:51.427418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:51.427864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.428159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.428477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.429202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:51.431135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:51.563777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1030/2060] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:51 2022] POST /identity/v3/projects => generated 385 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:51.567603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:51.580452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130abf4-682f-4b2f-8231-603f00600608 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:51.637931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:51.641397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.641397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.641397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.641397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:51.644157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:51.773873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1031/2061] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:51 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:51.778647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:51.793831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ff224-704b-4be7-8399-edd943399616 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:51.800478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78184177-308b-4bcb-9020-560c55e98874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:51.802906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184177-308b-4bcb-9020-560c55e98874 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.804023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184177-308b-4bcb-9020-560c55e98874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.804023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78184177-308b-4bcb-9020-560c55e98874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.804230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184177-308b-4bcb-9020-560c55e98874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:51.805849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78184177-308b-4bcb-9020-560c55e98874 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:51.817352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1031/2062] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:51.821691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:51.833188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3335294a-4385-481a-8fc9-5c071e7c1b64 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:51.838544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:51.839591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.839872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.840144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] PATH_INFO: `/v3/projects/e41760c7d4d043bcaa97c7cea1b4bee8/users/53935449c9c844c0b7d3b89d872db144/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.859720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41760c7d4d043bcaa97c7cea1b4bee8, user_id=53935449c9c844c0b7d3b89d872db144, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:51.862551 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:51.926914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:51.927237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:51.928253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:51.960124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1032/2063] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:51 2022] PUT /identity/v3/projects/e41760c7d4d043bcaa97c7cea1b4bee8/users/53935449c9c844c0b7d3b89d872db144/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:51.966960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:51.977747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] MFA Rules not processed for user `bc199810e9d04a5b87de196d3ff089f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:51.979970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:52.077023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73465f05-6feb-4a93-bc44-c8f8f21de879 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.084107 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.084475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1032/2064] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:52.087893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.087893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.087893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.087893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.088708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.089462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.093899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:52.103370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1033/2065] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:52.108979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.115738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ac5e1-8509-4f40-946d-666ae4284e93 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.120866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdb683-3a83-413a-b894-ea9a6783ce6a admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.134016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e4853-a13b-4f90-82a6-d81bb601acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.134016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e4853-a13b-4f90-82a6-d81bb601acc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.134016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e4853-a13b-4f90-82a6-d81bb601acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.134016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e4853-a13b-4f90-82a6-d81bb601acc2 admin admin] PATH_INFO: `/v3/projects/e41760c7d4d043bcaa97c7cea1b4bee8/users/53935449c9c844c0b7d3b89d872db144/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.134534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e4853-a13b-4f90-82a6-d81bb601acc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e41760c7d4d043bcaa97c7cea1b4bee8, user_id=53935449c9c844c0b7d3b89d872db144, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.134877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.134877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.134877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.136226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e4853-a13b-4f90-82a6-d81bb601acc2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.136930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.139223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.141437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.149700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1034/2066] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:52 2022] PUT /identity/v3/projects/e41760c7d4d043bcaa97c7cea1b4bee8/users/53935449c9c844c0b7d3b89d872db144/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:52.167944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.168245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.168587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.202703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] MFA Rules not processed for user `53935449c9c844c0b7d3b89d872db144`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:52.204685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:52.247826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1033/2067] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:54:52 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:54:52.248769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.338075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1035/2068] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:52 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:52.345175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c165742-66c6-4c35-869d-849db00cabda admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.352326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.353059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.353550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.353848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.355031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.355151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.356515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.357335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:52.431836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf2862-3cf6-44ba-a5ec-82d0478d9f8b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.451674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:52.488593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1034/2069] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:54:52 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:54:52.492559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.505296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.506523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.506816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.507142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.514745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b75673-02a8-4165-b05d-000a6ef60861 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.520894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.521628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.521961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.522249 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.523005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.524711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.538780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1035/2070] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:54:52.544028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.554086 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8974d-71da-428c-9fdb-06f2d845efb6 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.559547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.560552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.560937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.561225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] PATH_INFO: `/v3/projects/6678a6f4e142482a92a36580a833efa7/users/949b6b828bfc478f980f56ce355087f4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.564064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:52.582661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6678a6f4e142482a92a36580a833efa7, user_id=949b6b828bfc478f980f56ce355087f4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.585690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.588824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.590485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.600959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1036/2071] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:54:52.676755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1036/2072] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:52 2022] PUT /identity/v3/projects/6678a6f4e142482a92a36580a833efa7/users/949b6b828bfc478f980f56ce355087f4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:54:52.680834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.698699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570fdca-4281-4bb1-ad7b-77a4e4e1fe59 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.809701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6b6a3-7a5c-4630-a781-a69575ef0b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.810498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b6a3-7a5c-4630-a781-a69575ef0b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.810907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b6a3-7a5c-4630-a781-a69575ef0b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.811366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6b6a3-7a5c-4630-a781-a69575ef0b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.812376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6b6a3-7a5c-4630-a781-a69575ef0b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.814673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6b6a3-7a5c-4630-a781-a69575ef0b90 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.827844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1037/2073] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:54:52.832326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:52.845558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45577b50-a668-41b0-9585-0f4789667c7e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:52.853349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61fc8c-6cfb-4627-9002-11107257cfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:52.854572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61fc8c-6cfb-4627-9002-11107257cfe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:52.854915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61fc8c-6cfb-4627-9002-11107257cfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:52.855434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61fc8c-6cfb-4627-9002-11107257cfe0 admin admin] PATH_INFO: `/v3/projects/6678a6f4e142482a92a36580a833efa7/users/949b6b828bfc478f980f56ce355087f4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:52.858835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61fc8c-6cfb-4627-9002-11107257cfe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6678a6f4e142482a92a36580a833efa7, user_id=949b6b828bfc478f980f56ce355087f4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:52.862895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61fc8c-6cfb-4627-9002-11107257cfe0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:52.877624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1037/2074] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:54:52 2022] PUT /identity/v3/projects/6678a6f4e142482a92a36580a833efa7/users/949b6b828bfc478f980f56ce355087f4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:54:54.064734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:54.149020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:54.299608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5cdc-2bab-4981-8f75-e06dc0857c0d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:54.300064 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5cdc-2bab-4981-8f75-e06dc0857c0d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:54.300339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b5cdc-2bab-4981-8f75-e06dc0857c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:54.320493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-df0b5cdc-2bab-4981-8f75-e06dc0857c0d None None] MFA Rules not processed for user `65aafb8e5b564f6894cb49f2de27d4d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:54.322748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-df0b5cdc-2bab-4981-8f75-e06dc0857c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:54.395704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1038/2075] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:54:54.479045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8009-311a-4f9f-8ac4-0865f55f5c65 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:54.479340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8009-311a-4f9f-8ac4-0865f55f5c65 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:54.479624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8009-311a-4f9f-8ac4-0865f55f5c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:54.527681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-08bf8009-311a-4f9f-8ac4-0865f55f5c65 None None] MFA Rules not processed for user `949b6b828bfc478f980f56ce355087f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:54:54.528968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-08bf8009-311a-4f9f-8ac4-0865f55f5c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:54:54.653219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1038/2076] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:54:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:54:54.665241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b5cdc-2bab-4981-8f75-e06dc0857c0d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:54:54.729273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b5cdc-2bab-4981-8f75-e06dc0857c0d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:54:54.733219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:54:54.733969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:54:54.735300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:54:54.735300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:54:54.804794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:54:54.806425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:54:54.821678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1039/2077] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:54:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:54:55.357035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:55.417704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.363936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.432765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.611826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.658209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.736095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.754613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.826800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.849586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:56.920908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.011595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.040496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.146711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.169653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.392813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.526276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=10,keystone:SELECT=90 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.693597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:INSERT=2,keystone:DELETE=16,keystone:SELECT=82 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.721258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.891957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:57.972079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:58.290199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:58.343027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:58.743052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:58.805972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:58.895505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:DELETE=14,keystone:SELECT=78,keystone:INSERT=8 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:58.994772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:59.100955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:54:59.611601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.166026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.194685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.298256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.337253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.428534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.454827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.532255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.554338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.658120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.686262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:DELETE=5,keystone:SELECT=89,keystone:INSERT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.789504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.895067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:00.924284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:01.078464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:01.177903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:01.274748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:05.234898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8009-311a-4f9f-8ac4-0865f55f5c65 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:05.257755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:05.264951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8009-311a-4f9f-8ac4-0865f55f5c65 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:05.264951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:05.265357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:05.266005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:05.267066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:05.268957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:05.393627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:05.395080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:05.405431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1039/2078] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:06.376499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:06.396443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d40d6-0549-4860-b50d-36901b79d490 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:06.400095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:06.400769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:06.401057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:06.401339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:06.414781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:06.416564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:06.427271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1040/2079] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:14.043251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:14.053120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f3738-ef79-4d2b-afc7-874224785d30 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:14.056924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90922220-41f5-4e71-9048-b4e1f852ac80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:14.057573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922220-41f5-4e71-9048-b4e1f852ac80 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:14.057860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922220-41f5-4e71-9048-b4e1f852ac80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:14.058159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90922220-41f5-4e71-9048-b4e1f852ac80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:14.122925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90922220-41f5-4e71-9048-b4e1f852ac80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:14.124498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90922220-41f5-4e71-9048-b4e1f852ac80 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:14.135366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1040/2080] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:15.592578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:15.594380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:15.715738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbe532-bded-4d2f-83bb-7d2ea7146387 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:15.721429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:15.722565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:15.722816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:15.723094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] PATH_INFO: `/v3/users/6073bcab1c7e425d826a369100676057` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:15.724313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6073bcab1c7e425d826a369100676057)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:15.726368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:15.940121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6073bcab1c7e425d826a369100676057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.034772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6073bcab1c7e425d826a369100676057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.051951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6073bcab1c7e425d826a369100676057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.060008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6073bcab1c7e425d826a369100676057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.060898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6073bcab1c7e425d826a369100676057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.063142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:16.077635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1041/2081] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:15 2022] DELETE /identity/v3/users/6073bcab1c7e425d826a369100676057 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:16.081251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:16.081730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:16.085484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:16.122344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:16.125178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:16.197595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:16.208021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1041/2082] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:16.218783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:16.220275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:16.306929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655869e1-ee09-448f-9be4-ebf330d81a93 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:16.310579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:16.311220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:16.311505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:16.311783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:16.320987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:16.325666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:16.332713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1042/2083] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:16.731805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:16.733375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:16.749254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc182-3664-4564-8ecf-3077a234c453 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:16.754671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:16.755547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:16.755830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:16.756109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] PATH_INFO: `/v3/projects/2c7d551dcd1648d78b93801a192aa29b` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:16.757480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c7d551dcd1648d78b93801a192aa29b)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:16.759394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:16.880670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c7d551dcd1648d78b93801a192aa29b', 'request_id': 'req-ddb95fa8-d05f-4d12-ba29-fd599053880c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.886858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c7d551dcd1648d78b93801a192aa29b', 'request_id': 'req-ddb95fa8-d05f-4d12-ba29-fd599053880c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.948384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c7d551dcd1648d78b93801a192aa29b', 'request_id': 'req-ddb95fa8-d05f-4d12-ba29-fd599053880c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.960046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] The token cache is being invalidate because project 2c7d551dcd1648d78b93801a192aa29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:16.960334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.961006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:16.962561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1042/2084] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:16 2022] DELETE /identity/v3/projects/2c7d551dcd1648d78b93801a192aa29b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:16.966556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:16.977479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89a1ff-1b74-40ca-ad34-234c0f1aa8d0 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:17.038635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:17.039610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:17.039892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:17.040167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] PATH_INFO: `/v3/users/a154b48791df4999a6029dd3a1027b7b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:17.041445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a154b48791df4999a6029dd3a1027b7b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:17.043555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:17.288062 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a154b48791df4999a6029dd3a1027b7b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:17.400108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a154b48791df4999a6029dd3a1027b7b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:17.413175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a154b48791df4999a6029dd3a1027b7b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:17.417697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:17.420714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a154b48791df4999a6029dd3a1027b7b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:17.421369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5e9f56f4-dee3-47b3-9864-82d060158e9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a154b48791df4999a6029dd3a1027b7b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:17.428184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1043/2085] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:16 2022] DELETE /identity/v3/users/a154b48791df4999a6029dd3a1027b7b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:17.834227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:17.836097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:17.855725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb95fa8-d05f-4d12-ba29-fd599053880c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:17.922141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:17.923010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:17.923353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:17.923659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] PATH_INFO: `/v3/projects/ebadd3aaafcc484d9635d6d06c4e6ac5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:17.925110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebadd3aaafcc484d9635d6d06c4e6ac5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:17.926998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:18.095433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebadd3aaafcc484d9635d6d06c4e6ac5', 'request_id': 'req-812bd58d-c988-4314-9487-928612da22ee'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:18.102883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebadd3aaafcc484d9635d6d06c4e6ac5', 'request_id': 'req-812bd58d-c988-4314-9487-928612da22ee'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:18.190881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebadd3aaafcc484d9635d6d06c4e6ac5', 'request_id': 'req-812bd58d-c988-4314-9487-928612da22ee'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:18.202519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] The token cache is being invalidate because project ebadd3aaafcc484d9635d6d06c4e6ac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:18.207399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:18.207399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-812bd58d-c988-4314-9487-928612da22ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:18.207399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1043/2086] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:17 2022] DELETE /identity/v3/projects/ebadd3aaafcc484d9635d6d06c4e6ac5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:18.212843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9325c-9aff-4409-aed9-845b3b04c041 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.212843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9325c-9aff-4409-aed9-845b3b04c041 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.212843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9325c-9aff-4409-aed9-845b3b04c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.254124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-48b9325c-9aff-4409-aed9-845b3b04c041 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:18.255344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-48b9325c-9aff-4409-aed9-845b3b04c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:18.318011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1044/2087] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:18.326072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94e1b-ec40-4f61-a60c-2503e737bd54 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.326352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94e1b-ec40-4f61-a60c-2503e737bd54 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.326639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94e1b-ec40-4f61-a60c-2503e737bd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.345740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7fe94e1b-ec40-4f61-a60c-2503e737bd54 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:18.346993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7fe94e1b-ec40-4f61-a60c-2503e737bd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:18.354919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1044/2088] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:18.359100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9325c-9aff-4409-aed9-845b3b04c041 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:18.368937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9325c-9aff-4409-aed9-845b3b04c041 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:18.373846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:18.374506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.374795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.375079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.375809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:18.376125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:18.378300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:18.390406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1045/2089] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:18.395504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94e1b-ec40-4f61-a60c-2503e737bd54 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:18.402527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:18.406692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94e1b-ec40-4f61-a60c-2503e737bd54 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:18.412037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:18.412728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.413019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.413300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.414001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:18.415911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:18.516935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1045/2090] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:18 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:18.523811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:18.534691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a07a04-8f8b-4ff7-99b8-8546286a1720 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:18.596608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:18.597198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.597480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.597756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.598471 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:18.600478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:18.674464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1046/2091] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:18 2022] POST /identity/v3/users => generated 284 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:18.678508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:18.688816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a37d6-54ea-4fa4-ac94-507345244764 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:18.694470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:18.695174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.695464 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.695746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.696540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:18.698141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:18.708830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1046/2092] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:18.712753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:18.722837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ff0aa-4acc-44a0-993c-3725645c7aff admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:18.727841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d05dc-408f-4de2-b1d2-3042d70fbdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:18.728603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d05dc-408f-4de2-b1d2-3042d70fbdcd admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.728894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d05dc-408f-4de2-b1d2-3042d70fbdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.729202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d05dc-408f-4de2-b1d2-3042d70fbdcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.729931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d05dc-408f-4de2-b1d2-3042d70fbdcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:18.731584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d05dc-408f-4de2-b1d2-3042d70fbdcd admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:18.742756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1047/2093] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:18.747052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:18.758277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e57d7-622e-43b9-86ef-4fb5befcd530 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:18.762966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:18.763925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.764214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.764525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] PATH_INFO: `/v3/projects/296486ddd32447b88a1e02662632a8ef/users/155b6c98fada49b2852d9025340f5179/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.779220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] RBAC: Authorizing `identity:create_grant(project_id=296486ddd32447b88a1e02662632a8ef, user_id=155b6c98fada49b2852d9025340f5179, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:18.781950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:18.845478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1047/2094] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:18 2022] PUT /identity/v3/projects/296486ddd32447b88a1e02662632a8ef/users/155b6c98fada49b2852d9025340f5179/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:18.857099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab39b-5c80-4495-be8b-a66e54a1366f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:18.857398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab39b-5c80-4495-be8b-a66e54a1366f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:18.857687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fab39b-5c80-4495-be8b-a66e54a1366f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:18.888369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-f2fab39b-5c80-4495-be8b-a66e54a1366f None None] MFA Rules not processed for user `155b6c98fada49b2852d9025340f5179`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:18.892898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f2fab39b-5c80-4495-be8b-a66e54a1366f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:18.923202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:18.961280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1048/2095] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:18.962769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:19.031302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987a6fd-215d-40a6-adf0-7da51b291ebe admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:19.037259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:19.041859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.041859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.041859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.041859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:19.041859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:19.125062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1048/2096] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:18 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:19.129100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fab39b-5c80-4495-be8b-a66e54a1366f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:19.140149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fab39b-5c80-4495-be8b-a66e54a1366f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:19.201188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:19.201869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.202154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.202433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.203148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:19.205753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:19.312178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1049/2097] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:19 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:19.316383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:19.327514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdb0f8-8a51-4bb4-a1f7-46882286964e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:19.333370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:19.334045 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.334337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.334624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.335365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:19.337072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:19.349935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1049/2098] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:19.354721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:19.364888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368ebc9-fb96-49cb-997f-75ce53a73d45 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:19.369416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:19.370283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.370563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.370839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] PATH_INFO: `/v3/projects/cbc1cffb0eb04e94ac02d5f743d9bc03/users/ceca5b1965ac49dc80b1ee55e153fc9e/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.385074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc1cffb0eb04e94ac02d5f743d9bc03, user_id=ceca5b1965ac49dc80b1ee55e153fc9e, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:19.387660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:19.454950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1050/2099] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:19 2022] PUT /identity/v3/projects/cbc1cffb0eb04e94ac02d5f743d9bc03/users/ceca5b1965ac49dc80b1ee55e153fc9e/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:19.459312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:19.469285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbafcfd-2f55-4d4c-8afd-c8baf96a672c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:19.525997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86ed67-f436-42e2-bd8f-79b1e82b1778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:19.526713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ed67-f436-42e2-bd8f-79b1e82b1778 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.527004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ed67-f436-42e2-bd8f-79b1e82b1778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.527282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86ed67-f436-42e2-bd8f-79b1e82b1778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.527996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86ed67-f436-42e2-bd8f-79b1e82b1778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:19.529629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86ed67-f436-42e2-bd8f-79b1e82b1778 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:19.539816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1050/2100] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:19.544595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:19.556732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f421b3d-2baf-4c05-939c-c1276cd1714c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:19.561871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:19.563072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.563434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.563777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] PATH_INFO: `/v3/projects/cbc1cffb0eb04e94ac02d5f743d9bc03/users/ceca5b1965ac49dc80b1ee55e153fc9e/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.567960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc1cffb0eb04e94ac02d5f743d9bc03, user_id=ceca5b1965ac49dc80b1ee55e153fc9e, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:19.570774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:19.585618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1051/2101] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:19 2022] PUT /identity/v3/projects/cbc1cffb0eb04e94ac02d5f743d9bc03/users/ceca5b1965ac49dc80b1ee55e153fc9e/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:19.595631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01af8c-659f-4363-b744-3a48f7449e65 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.596066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01af8c-659f-4363-b744-3a48f7449e65 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.596579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01af8c-659f-4363-b744-3a48f7449e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.628655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-da01af8c-659f-4363-b744-3a48f7449e65 None None] MFA Rules not processed for user `ceca5b1965ac49dc80b1ee55e153fc9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:19.629888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-da01af8c-659f-4363-b744-3a48f7449e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:19.635367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:19.700528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1051/2102] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:19.713203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:19.715091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:19.771903 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c7e37-9920-437b-ad2c-8b457b3e2543 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:19.775489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:19.776120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:19.776413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:19.776709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:19.785666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:19.787090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:19.796259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1052/2103] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:19.990972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01af8c-659f-4363-b744-3a48f7449e65 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:20.000579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01af8c-659f-4363-b744-3a48f7449e65 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:20.005041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:20.005672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:20.005956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:20.006235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:20.062252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:20.063690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:20.073440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1052/2104] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:29.792234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:30.069359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=54 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:36.380033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:36.419069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:36.420920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:36.525663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8498c4e2-6c8d-4cf6-a993-6814928b1507 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:36.530720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:36.531863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:36.532525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:36.532968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] PATH_INFO: `/v3/users/155b6c98fada49b2852d9025340f5179` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:36.534356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=155b6c98fada49b2852d9025340f5179)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:36.538823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:36.599172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae744fa-8c9c-4335-976d-c5b101b46a9f service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:36.612527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:36.614393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:36.614809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:36.615214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] PATH_INFO: `/v3/users/37b6a241b83445a3ad2361210d223677` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:36.616976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b6a241b83445a3ad2361210d223677)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:36.619695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:36.774887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '155b6c98fada49b2852d9025340f5179'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.817861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b6a241b83445a3ad2361210d223677'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.837814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '155b6c98fada49b2852d9025340f5179'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.865088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '155b6c98fada49b2852d9025340f5179'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.876434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '155b6c98fada49b2852d9025340f5179'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.877292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-36a149f5-f30a-4330-8326-fe7fa987dff1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '155b6c98fada49b2852d9025340f5179'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.884371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1053/2105] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:36 2022] DELETE /identity/v3/users/155b6c98fada49b2852d9025340f5179 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:36.888494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462be44-7366-4760-928b-00337571c30f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:36.888866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462be44-7366-4760-928b-00337571c30f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:36.889230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462be44-7366-4760-928b-00337571c30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:36.907472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-1462be44-7366-4760-928b-00337571c30f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:36.908988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1462be44-7366-4760-928b-00337571c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:36.918359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b6a241b83445a3ad2361210d223677'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.944782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b6a241b83445a3ad2361210d223677'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.960218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b6a241b83445a3ad2361210d223677'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.961031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5cbcfcfc-38c1-4b3b-8950-a67d074aacab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b6a241b83445a3ad2361210d223677'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:36.972715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1053/2106] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:36 2022] DELETE /identity/v3/users/37b6a241b83445a3ad2361210d223677 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:36.974443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:36.974884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:36.976244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:36.998705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1054/2107] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:37.003543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:37.004811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:37.008635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462be44-7366-4760-928b-00337571c30f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:37.013335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1462be44-7366-4760-928b-00337571c30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:37.036092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:37.082247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1054/2108] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:37.093823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:37.095390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:37.095898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462be44-7366-4760-928b-00337571c30f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:37.119970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:37.152928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:37.153584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:37.153870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:37.154148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:37.161572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee483a-c018-40a5-b40a-b23595e95926 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:37.165031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:37.165435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:37.166087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:37.166373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:37.174026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:37.174159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:37.176998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:37.177483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1055/2109] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:55:37.178598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:37.188365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1055/2110] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:37.743309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:37.746097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:37.768949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70dc25-68c4-4cd8-9be7-098d2f96a040 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:37.771615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:37.773170 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:37.788014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c6354-b749-4f80-a970-f28b3ac5fd01 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:37.790782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:37.791678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:37.791966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:37.792252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] PATH_INFO: `/v3/projects/ef45b613caee410da5a0e5f091da186f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:37.794452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:37.795260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef45b613caee410da5a0e5f091da186f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:37.795780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:37.796558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:37.797039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] PATH_INFO: `/v3/projects/296486ddd32447b88a1e02662632a8ef` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:37.812379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:37.812810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=296486ddd32447b88a1e02662632a8ef)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:37.812810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:37.899039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '296486ddd32447b88a1e02662632a8ef', 'request_id': 'req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:37.909455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '296486ddd32447b88a1e02662632a8ef', 'request_id': 'req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:37.920413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef45b613caee410da5a0e5f091da186f', 'request_id': 'req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:37.927385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef45b613caee410da5a0e5f091da186f', 'request_id': 'req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.015211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '296486ddd32447b88a1e02662632a8ef', 'request_id': 'req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.028952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] The token cache is being invalidate because project 296486ddd32447b88a1e02662632a8ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:38.029244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.029896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.031557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1056/2111] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:37 2022] DELETE /identity/v3/projects/296486ddd32447b88a1e02662632a8ef => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:38.035548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:38.037022 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:38.103681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16b67c-f4b8-4077-bf39-c4d9aaf4efe2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:38.106910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef45b613caee410da5a0e5f091da186f', 'request_id': 'req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.148373 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] The token cache is being invalidate because project ef45b613caee410da5a0e5f091da186f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:38.148690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.149797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.168464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1056/2112] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:37 2022] DELETE /identity/v3/projects/ef45b613caee410da5a0e5f091da186f => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:38.171111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:38.172594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:38.181739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:38.191745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:38.196781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:38.196781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:38.196781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] PATH_INFO: `/v3/users/ceca5b1965ac49dc80b1ee55e153fc9e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:38.196781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceca5b1965ac49dc80b1ee55e153fc9e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:38.196781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:38.245941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469fe62-906f-4d17-a8ee-dc0c7b2526ad admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:38.250768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:38.251641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:38.251931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:38.252213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] PATH_INFO: `/v3/users/53935449c9c844c0b7d3b89d872db144` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:38.254058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53935449c9c844c0b7d3b89d872db144)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:38.256060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:38.259045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:38.431448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceca5b1965ac49dc80b1ee55e153fc9e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.507343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53935449c9c844c0b7d3b89d872db144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.519813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceca5b1965ac49dc80b1ee55e153fc9e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.532279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceca5b1965ac49dc80b1ee55e153fc9e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.540270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceca5b1965ac49dc80b1ee55e153fc9e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.541024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceca5b1965ac49dc80b1ee55e153fc9e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.546914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1057/2113] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:38 2022] DELETE /identity/v3/users/ceca5b1965ac49dc80b1ee55e153fc9e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:38.672086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53935449c9c844c0b7d3b89d872db144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.689299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53935449c9c844c0b7d3b89d872db144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.695902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53935449c9c844c0b7d3b89d872db144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.696615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53935449c9c844c0b7d3b89d872db144'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:38.702956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1057/2114] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:38 2022] DELETE /identity/v3/users/53935449c9c844c0b7d3b89d872db144 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:39.133057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.134676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:39.242659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524554b-6ad5-475e-b918-bdefd5ca591d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.303707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.304612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.304898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.305177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] PATH_INFO: `/v3/projects/e41760c7d4d043bcaa97c7cea1b4bee8` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.306359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e41760c7d4d043bcaa97c7cea1b4bee8)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.308364 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:39.332568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:39.345987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.348520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:39.368917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b3a10-7bf6-4381-aefc-ac00a3d0e466 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.376350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.377306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.377660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.378013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] PATH_INFO: `/v3/projects/cbc1cffb0eb04e94ac02d5f743d9bc03` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.379424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc1cffb0eb04e94ac02d5f743d9bc03)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.381539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:39.451584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e41760c7d4d043bcaa97c7cea1b4bee8', 'request_id': 'req-5a8ea132-d7f6-4603-ab47-17934b30cf9b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.458365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e41760c7d4d043bcaa97c7cea1b4bee8', 'request_id': 'req-5a8ea132-d7f6-4603-ab47-17934b30cf9b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.501459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc1cffb0eb04e94ac02d5f743d9bc03', 'request_id': 'req-01be31f7-a426-4212-9173-0407a7853248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.507878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc1cffb0eb04e94ac02d5f743d9bc03', 'request_id': 'req-01be31f7-a426-4212-9173-0407a7853248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.540327 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e41760c7d4d043bcaa97c7cea1b4bee8', 'request_id': 'req-5a8ea132-d7f6-4603-ab47-17934b30cf9b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.551133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] The token cache is being invalidate because project e41760c7d4d043bcaa97c7cea1b4bee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:39.551401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.552021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5a8ea132-d7f6-4603-ab47-17934b30cf9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.553926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1058/2115] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:39 2022] DELETE /identity/v3/projects/e41760c7d4d043bcaa97c7cea1b4bee8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:39.559437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab9d7-0c35-4c51-9fa1-060b05a944d5 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.559728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab9d7-0c35-4c51-9fa1-060b05a944d5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.560007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ab9d7-0c35-4c51-9fa1-060b05a944d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.589169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ea8ab9d7-0c35-4c51-9fa1-060b05a944d5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:39.590490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ea8ab9d7-0c35-4c51-9fa1-060b05a944d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:39.600095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc1cffb0eb04e94ac02d5f743d9bc03', 'request_id': 'req-01be31f7-a426-4212-9173-0407a7853248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.611658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] The token cache is being invalidate because project cbc1cffb0eb04e94ac02d5f743d9bc03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:39.611952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.612644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-01be31f7-a426-4212-9173-0407a7853248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:39.614356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1058/2116] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:39 2022] DELETE /identity/v3/projects/cbc1cffb0eb04e94ac02d5f743d9bc03 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:39.619199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405fca5-7e45-4819-833e-4b6989173f9b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.619491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405fca5-7e45-4819-833e-4b6989173f9b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.619773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405fca5-7e45-4819-833e-4b6989173f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.638429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7405fca5-7e45-4819-833e-4b6989173f9b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:39.639646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7405fca5-7e45-4819-833e-4b6989173f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:39.651636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1059/2117] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:39.660480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e5c1-c175-4a6b-a805-e1bb08cb7d1e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.660799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e5c1-c175-4a6b-a805-e1bb08cb7d1e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.661192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb1e5c1-c175-4a6b-a805-e1bb08cb7d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.679791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7fb1e5c1-c175-4a6b-a805-e1bb08cb7d1e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:39.681036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7fb1e5c1-c175-4a6b-a805-e1bb08cb7d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:39.690821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1060/2118] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:39.696175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e5c1-c175-4a6b-a805-e1bb08cb7d1e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.708758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb1e5c1-c175-4a6b-a805-e1bb08cb7d1e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.712086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1059/2119] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:39.713976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.714736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.715124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.715510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.716481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:39.716795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.718497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:39.721325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a389a-aa4e-4127-8a85-b6d837825dcf None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.721715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a389a-aa4e-4127-8a85-b6d837825dcf None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.721913 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a389a-aa4e-4127-8a85-b6d837825dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.730567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1061/2120] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:55:39.733489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:39.737406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.745896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3e2a389a-aa4e-4127-8a85-b6d837825dcf None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:39.747308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3e2a389a-aa4e-4127-8a85-b6d837825dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:39.752108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacb57-61e3-4c34-a8c2-d47f14635ad1 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.758954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1060/2121] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:39.759101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.759101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.759101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.766643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.766643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.766643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:39.771220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a389a-aa4e-4127-8a85-b6d837825dcf None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.780948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a389a-aa4e-4127-8a85-b6d837825dcf None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.786346 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.787013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.787611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.788161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.789002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:39.789738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.791486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:39.804277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1061/2122] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:39.808391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.818311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c0141-fea7-444b-8a39-c2136d31ee40 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.823024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.823643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.823930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.824212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.825200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.827063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:39.850801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1062/2123] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:39.852019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.913602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1062/2124] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:39.914229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff76d8-2ef5-4a0b-aa2a-15b8023a5922 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.914650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:39.917942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:39.970848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.971433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.971716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.971994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.973398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.975320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:39.979342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993ea2e-392a-4e5b-a693-f720603b32e4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:39.984204 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:39.984911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:39.985534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:39.985534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:39.986156 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:39.988793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.083559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1063/2125] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/users => generated 288 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:40.084558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1063/2126] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:39 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:40.087782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.089032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.098412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fed079-8791-40c6-a37d-e951b4bc1021 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.099000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50b5a0-24b9-4c38-8269-b7578056fe89 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.103376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.104224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.104523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.104715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.104974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.105179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.105471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.105705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.105804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.106478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.107309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.108066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.118457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1064/2127] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:55:40.119188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1064/2128] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:40.122640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.123067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.132638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c833d6-eed5-42b4-b445-5f22ed717ae6 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.132897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ca0e-8ae2-406e-8b1b-4f146192092c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.137185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.137490 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.137936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.138091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.138253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.138369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.138577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.138854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.139084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.139573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.140697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.141215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.154353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1065/2129] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:55:40.154548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1065/2130] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:40.155511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.155642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.166524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd26572-4c6d-4045-880f-2f78a9b3b819 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.166651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23690333-26fa-44a8-bb36-0f8bd11a7ad9 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.171337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df4534-79a5-401c-86d9-a608d08b468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.172250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4534-79a5-401c-86d9-a608d08b468c admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.172466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ee778-5a9d-430a-8b2d-e4448bdd9f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.172582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4534-79a5-401c-86d9-a608d08b468c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.172911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df4534-79a5-401c-86d9-a608d08b468c admin admin] PATH_INFO: `/v3/projects/66af33fe42804a44bd82d419f4f176c1/users/0062619fdb344919984be4878596cb05/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.173287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee778-5a9d-430a-8b2d-e4448bdd9f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.173681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee778-5a9d-430a-8b2d-e4448bdd9f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.173982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ee778-5a9d-430a-8b2d-e4448bdd9f2f admin admin] PATH_INFO: `/v3/projects/fbd1d04529bf48f598cfe9a2d13570df/users/dfa6af055ba04557b0908bfad5c69f64/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.189468 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df4534-79a5-401c-86d9-a608d08b468c admin admin] RBAC: Authorizing `identity:create_grant(project_id=66af33fe42804a44bd82d419f4f176c1, user_id=0062619fdb344919984be4878596cb05, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.190533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ee778-5a9d-430a-8b2d-e4448bdd9f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbd1d04529bf48f598cfe9a2d13570df, user_id=dfa6af055ba04557b0908bfad5c69f64, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.192431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df4534-79a5-401c-86d9-a608d08b468c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.193644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ee778-5a9d-430a-8b2d-e4448bdd9f2f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.283133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1066/2131] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:40 2022] PUT /identity/v3/projects/66af33fe42804a44bd82d419f4f176c1/users/0062619fdb344919984be4878596cb05/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:40.295663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f59fb-02fd-468e-8c72-db73226ee217 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.296007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f59fb-02fd-468e-8c72-db73226ee217 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.296224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f59fb-02fd-468e-8c72-db73226ee217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.314895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1066/2132] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:40 2022] PUT /identity/v3/projects/fbd1d04529bf48f598cfe9a2d13570df/users/dfa6af055ba04557b0908bfad5c69f64/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:40.328209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0471bec-53fa-4115-95dd-9f4a151eee51 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.328689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0471bec-53fa-4115-95dd-9f4a151eee51 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.329043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0471bec-53fa-4115-95dd-9f4a151eee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.346398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-014f59fb-02fd-468e-8c72-db73226ee217 None None] MFA Rules not processed for user `0062619fdb344919984be4878596cb05`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:40.348812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-014f59fb-02fd-468e-8c72-db73226ee217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:40.358370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b0471bec-53fa-4115-95dd-9f4a151eee51 None None] MFA Rules not processed for user `dfa6af055ba04557b0908bfad5c69f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:40.360600 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b0471bec-53fa-4115-95dd-9f4a151eee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:40.436620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:40.439976 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1067/2133] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:40.446520 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f59fb-02fd-468e-8c72-db73226ee217 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.447606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1067/2134] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:40.453776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0471bec-53fa-4115-95dd-9f4a151eee51 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.504389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:40.527515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f59fb-02fd-468e-8c72-db73226ee217 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.536534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0471bec-53fa-4115-95dd-9f4a151eee51 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.564715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.564715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.564715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.564715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.565121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.565220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.565321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.565321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.565321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.565321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.565618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.565721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.635442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1068/2135] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:40 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:40.639387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.649804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1068/2136] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:40 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:40.651048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.702385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f1cb6-8e2c-4177-942f-5c479918dc35 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.714732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb709392-5320-4a5b-99e3-4f4ba61f2aeb admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.719421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.720090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.720383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.720700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.721391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.723827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.759261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.759939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.760228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.760543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.761273 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.763194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.812153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1069/2137] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:40 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:40.815876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.825997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8366b-e6a1-4218-a466-c9543b110e3d admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.830687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.831333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.831816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.832101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.832857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.834452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.844944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1070/2138] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:55:40.849553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.860423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b1bd6-9b05-4e5e-8825-7ca6b20297eb admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.865965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.866855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.867187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.867417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] PATH_INFO: `/v3/projects/522ec371da0d4f1f9d6f4e41f21c0d3c/users/8f3ce8da554c4441abd755c948db6055/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.875500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1069/2139] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:40 2022] POST /identity/v3/users => generated 299 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:40.876816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.883929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=522ec371da0d4f1f9d6f4e41f21c0d3c, user_id=8f3ce8da554c4441abd755c948db6055, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.886653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.887480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032e7c1-3e2f-4902-9695-20488b193612 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.892299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.893011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.893295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.893572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.894375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.896111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.905998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1070/2140] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:40.913024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:40.922418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8503af-ea37-4a6a-9414-9769f4929650 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:40.929503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:40.930669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:40.930939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:40.931280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] PATH_INFO: `/v3/projects/d69b9051c99d41938cc53362bfe2830f/users/a62fa6dc19c44898a0fbbc84a2cde82e/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:40.947301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69b9051c99d41938cc53362bfe2830f, user_id=a62fa6dc19c44898a0fbbc84a2cde82e, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:40.950294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:40.964698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1071/2141] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:40 2022] PUT /identity/v3/projects/522ec371da0d4f1f9d6f4e41f21c0d3c/users/8f3ce8da554c4441abd755c948db6055/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:40.968626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:41.011951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:41.026940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1071/2142] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:40 2022] PUT /identity/v3/projects/d69b9051c99d41938cc53362bfe2830f/users/a62fa6dc19c44898a0fbbc84a2cde82e/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:41.030855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:41.037816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d6daf-b453-4809-af57-dec45acad99d admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:41.061186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:41.093702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5af3e-b6fb-4517-abaf-eb8b33ab4be5 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:41.094329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:41.095044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.095334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.095713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.096507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:41.098717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:41.098997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:41.099665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.099956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.100241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.101040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:41.102596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:41.109273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1072/2143] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:55:41.113031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1072/2144] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:55:41.113586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:41.116988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:41.123655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40269046-1ba6-4392-a16b-0f0fb63a7b6e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:41.126716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481199d2-a83c-4661-a967-5de6c1a3fac8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:41.128639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356a8fa-3457-494a-9d49-7e16ce1d48f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:41.129509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a8fa-3457-494a-9d49-7e16ce1d48f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.129796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a8fa-3457-494a-9d49-7e16ce1d48f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.130086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356a8fa-3457-494a-9d49-7e16ce1d48f4 admin admin] PATH_INFO: `/v3/projects/522ec371da0d4f1f9d6f4e41f21c0d3c/users/8f3ce8da554c4441abd755c948db6055/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.131910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a5124-86d0-46b5-a8fd-169927188549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:41.132082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a8fa-3457-494a-9d49-7e16ce1d48f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522ec371da0d4f1f9d6f4e41f21c0d3c, user_id=8f3ce8da554c4441abd755c948db6055, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:41.133156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a5124-86d0-46b5-a8fd-169927188549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.133503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a5124-86d0-46b5-a8fd-169927188549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.133785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a5124-86d0-46b5-a8fd-169927188549 admin admin] PATH_INFO: `/v3/projects/d69b9051c99d41938cc53362bfe2830f/users/a62fa6dc19c44898a0fbbc84a2cde82e/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.134856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356a8fa-3457-494a-9d49-7e16ce1d48f4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:41.135778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a5124-86d0-46b5-a8fd-169927188549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69b9051c99d41938cc53362bfe2830f, user_id=a62fa6dc19c44898a0fbbc84a2cde82e, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:41.138459 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958a5124-86d0-46b5-a8fd-169927188549 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:41.146100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1073/2145] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:41 2022] PUT /identity/v3/projects/522ec371da0d4f1f9d6f4e41f21c0d3c/users/8f3ce8da554c4441abd755c948db6055/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:41.149781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1073/2146] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:41 2022] PUT /identity/v3/projects/d69b9051c99d41938cc53362bfe2830f/users/a62fa6dc19c44898a0fbbc84a2cde82e/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:41.156396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.156720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.157005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.159523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.160446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.160728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.184457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] MFA Rules not processed for user `8f3ce8da554c4441abd755c948db6055`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:41.185691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:41.186770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] MFA Rules not processed for user `a62fa6dc19c44898a0fbbc84a2cde82e`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:41.188512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:41.261090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1074/2147] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:41.264588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1074/2148] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:41.273909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:41.275293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:41.275633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:41.277025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:41.336651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16027878-58c0-4a00-9bee-719e889aaf5b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:41.336874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4535256-7ea9-4ef7-8033-8d3e98dbbd44 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:41.340476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:41.340614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e6f32-e278-4ddc-87d1-1dad2ff29385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:41.341202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6f32-e278-4ddc-87d1-1dad2ff29385 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.341298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:41.341491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6f32-e278-4ddc-87d1-1dad2ff29385 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.341609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:41.341770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e6f32-e278-4ddc-87d1-1dad2ff29385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.341875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:41.346098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:41.351909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:41.353445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:41.363098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1075/2149] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:55:41.399730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e6f32-e278-4ddc-87d1-1dad2ff29385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:41.402003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e6f32-e278-4ddc-87d1-1dad2ff29385 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:41.412308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1075/2150] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:42.515194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:42.564652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:42.587155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ca6d8-4150-4d0e-adf3-72246b57c081 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:42.591735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:42.592640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:42.592945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:42.593253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] PATH_INFO: `/v3/users/0062619fdb344919984be4878596cb05` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:42.594608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0062619fdb344919984be4878596cb05)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:42.596605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:42.815723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0062619fdb344919984be4878596cb05'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:42.908156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0062619fdb344919984be4878596cb05'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:42.921431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0062619fdb344919984be4878596cb05'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:42.929415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0062619fdb344919984be4878596cb05'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:42.930089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0062619fdb344919984be4878596cb05'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:42.935969 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1076/2151] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:42 2022] DELETE /identity/v3/users/0062619fdb344919984be4878596cb05 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:42.940520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:42.941041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:42.941281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:42.960816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:42.962030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:43.024920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1076/2152] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:43.035105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:43.036856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:43.105219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d6e6d-da18-4cf2-b6b6-af9a46c5147a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:43.108874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:43.109522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:43.109815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:43.110103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:43.120384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:43.121914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:43.132642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1077/2153] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:43.647925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:43.649391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:43.664711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7101e2-ed78-4416-bde2-e70196bc4830 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:43.669765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:43.670636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:43.670924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:43.671205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] PATH_INFO: `/v3/projects/66af33fe42804a44bd82d419f4f176c1` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:43.672513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] RBAC: Authorizing `identity:delete_project(project_id=66af33fe42804a44bd82d419f4f176c1)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:43.674513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:43.760730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66af33fe42804a44bd82d419f4f176c1', 'request_id': 'req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:43.767220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66af33fe42804a44bd82d419f4f176c1', 'request_id': 'req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:43.828932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66af33fe42804a44bd82d419f4f176c1', 'request_id': 'req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:43.840888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] The token cache is being invalidate because project 66af33fe42804a44bd82d419f4f176c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:43.841273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:43.842167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:43.843472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1077/2154] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:43 2022] DELETE /identity/v3/projects/66af33fe42804a44bd82d419f4f176c1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:43.847456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:43.857946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768633a7-2b02-431a-aed7-6f3885041c98 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:43.923212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:43.924227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:43.924700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:43.924997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] PATH_INFO: `/v3/users/a62fa6dc19c44898a0fbbc84a2cde82e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:43.927345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62fa6dc19c44898a0fbbc84a2cde82e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:43.929633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:43.931336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:44.068229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62fa6dc19c44898a0fbbc84a2cde82e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.140247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62fa6dc19c44898a0fbbc84a2cde82e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.161189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62fa6dc19c44898a0fbbc84a2cde82e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.169753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62fa6dc19c44898a0fbbc84a2cde82e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.170698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4e6ad72d-829d-4d60-b379-a416ea331a25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62fa6dc19c44898a0fbbc84a2cde82e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.178619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1078/2155] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:43 2022] DELETE /identity/v3/users/a62fa6dc19c44898a0fbbc84a2cde82e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:44.628965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:44.628965 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:44.650244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36cdeba-f0a7-4ca2-8479-caeaf92c246c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:44.688127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:44.726673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:44.727691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:44.728136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:44.728502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] PATH_INFO: `/v3/projects/d69b9051c99d41938cc53362bfe2830f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:44.729738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69b9051c99d41938cc53362bfe2830f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:44.731928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:44.841993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69b9051c99d41938cc53362bfe2830f', 'request_id': 'req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.850618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69b9051c99d41938cc53362bfe2830f', 'request_id': 'req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.934560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69b9051c99d41938cc53362bfe2830f', 'request_id': 'req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.951179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] The token cache is being invalidate because project d69b9051c99d41938cc53362bfe2830f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:44.951632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.954339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ba182932-ce16-4a7c-a06e-e7ccfaa6f068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:44.957652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1078/2156] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:44 2022] DELETE /identity/v3/projects/d69b9051c99d41938cc53362bfe2830f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:44.962631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098b27-f24d-4183-8cf0-f8423f3e40de None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:44.963089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098b27-f24d-4183-8cf0-f8423f3e40de None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:44.963278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73098b27-f24d-4183-8cf0-f8423f3e40de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:44.983304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-73098b27-f24d-4183-8cf0-f8423f3e40de None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:44.984616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-73098b27-f24d-4183-8cf0-f8423f3e40de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:45.057730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1079/2157] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:45.067144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60140681-ace1-458e-a301-d275f0146de7 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.067572 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60140681-ace1-458e-a301-d275f0146de7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.067861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60140681-ace1-458e-a301-d275f0146de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.092470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-60140681-ace1-458e-a301-d275f0146de7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:45.093864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-60140681-ace1-458e-a301-d275f0146de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:45.120376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1079/2158] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:45.122046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098b27-f24d-4183-8cf0-f8423f3e40de None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:45.139860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73098b27-f24d-4183-8cf0-f8423f3e40de None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:45.147152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:45.148047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.148534 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.148963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.149878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:45.152668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:45.154799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:45.175813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60140681-ace1-458e-a301-d275f0146de7 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:45.176370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1080/2159] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:45.187379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60140681-ace1-458e-a301-d275f0146de7 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:45.196703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:45.197412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.197837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.198022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.198721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:45.202312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:45.367109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1080/2160] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:45 2022] POST /identity/v3/projects => generated 375 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:45.371071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:45.383087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f330-c139-409a-9e73-e914f049ab01 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:45.447886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:45.448625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.448913 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.449197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.450175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:45.452158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:45.463121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:45.578133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1081/2161] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:45 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:45.583336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:45.593644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b939c-f21d-4356-b0e6-4afdd308dcd1 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:45.598874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:45.599530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.599822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.600099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.600865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:45.602463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:45.612817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1081/2162] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:45.617055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:45.627037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd687388-3379-4907-8bce-3347cb9a79ec admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:45.631598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf16286-26ed-4d8b-b517-1f590f3d0163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:45.632253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16286-26ed-4d8b-b517-1f590f3d0163 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.632578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16286-26ed-4d8b-b517-1f590f3d0163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.632863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf16286-26ed-4d8b-b517-1f590f3d0163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.633637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf16286-26ed-4d8b-b517-1f590f3d0163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:45.635258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf16286-26ed-4d8b-b517-1f590f3d0163 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:45.646322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1082/2163] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:45.650523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:45.663564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bd05e-89fa-495d-89f8-4fa779b335b4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:45.668477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:45.669367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.669719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.670004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] PATH_INFO: `/v3/projects/8566082fb08e4655b49d4fbb0de6990e/users/b9bde55634d143248a0a42b6008185e6/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.689757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8566082fb08e4655b49d4fbb0de6990e, user_id=b9bde55634d143248a0a42b6008185e6, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:45.693981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:45.800784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1082/2164] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:45 2022] PUT /identity/v3/projects/8566082fb08e4655b49d4fbb0de6990e/users/b9bde55634d143248a0a42b6008185e6/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:45.811571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.811867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.812145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:45.840298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] MFA Rules not processed for user `b9bde55634d143248a0a42b6008185e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:45.841548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:45.913156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1083/2165] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:45.925568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:45.927388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:45.985095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5a25f-bd06-46cd-aeb2-b1e396318f3c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:45.989386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068ef49-812b-4b4d-97fa-57d5b84b68de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:45.990041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068ef49-812b-4b4d-97fa-57d5b84b68de service glance] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:45.990329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068ef49-812b-4b4d-97fa-57d5b84b68de service glance] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:45.990613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068ef49-812b-4b4d-97fa-57d5b84b68de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:46.004416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068ef49-812b-4b4d-97fa-57d5b84b68de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:46.004416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068ef49-812b-4b4d-97fa-57d5b84b68de service glance] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:46.005367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:46.013888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1083/2166] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:46.903366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:46.905028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:46.992227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1e892-4706-440a-ba5a-8c363ba52ef2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:46.998678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:46.999755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:47.000133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:47.000688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] PATH_INFO: `/v3/users/dfa6af055ba04557b0908bfad5c69f64` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:47.004223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa6af055ba04557b0908bfad5c69f64)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:47.006518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:47.257106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa6af055ba04557b0908bfad5c69f64'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:47.354589 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa6af055ba04557b0908bfad5c69f64'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:47.371376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa6af055ba04557b0908bfad5c69f64'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:47.376536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:47.380384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa6af055ba04557b0908bfad5c69f64'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:47.381349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa6af055ba04557b0908bfad5c69f64'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:47.388680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1084/2167] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:46 2022] DELETE /identity/v3/users/dfa6af055ba04557b0908bfad5c69f64 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:47.393243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcaf16-d764-4602-a5f2-e5f2c2a0e782 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:47.393727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcaf16-d764-4602-a5f2-e5f2c2a0e782 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:47.393818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcaf16-d764-4602-a5f2-e5f2c2a0e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:47.412909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-26dcaf16-d764-4602-a5f2-e5f2c2a0e782 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:47.414374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-26dcaf16-d764-4602-a5f2-e5f2c2a0e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:47.487824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1084/2168] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:47.516052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:47.516052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:47.584996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b6b48-fc65-4774-a8fa-b75fbbbbda69 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:47.588619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:47.589271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:47.589580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:47.589859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:47.599663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:47.601138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:47.611657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1085/2169] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:47.817756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:47.818047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:47.818328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:47.849344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:47.850737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:47.925404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1085/2170] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:47.977507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:47.979577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:48.089484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29f372-6b45-45d6-83e7-2383bf06e3ee service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:48.094857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:48.095580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:48.095869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:48.096169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:48.105795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:48.107627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:48.119435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1086/2171] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:55:48.168319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:48.169933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:48.185547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfb678-97d7-403b-ae62-90a985b47963 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:48.191482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:48.192238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:48.192536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:48.192866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] PATH_INFO: `/v3/projects/fbd1d04529bf48f598cfe9a2d13570df` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:48.194118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbd1d04529bf48f598cfe9a2d13570df)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:48.196277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:48.350381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbd1d04529bf48f598cfe9a2d13570df', 'request_id': 'req-ebcdf190-47d4-4e24-bb38-960fe462746b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.356458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbd1d04529bf48f598cfe9a2d13570df', 'request_id': 'req-ebcdf190-47d4-4e24-bb38-960fe462746b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.468542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbd1d04529bf48f598cfe9a2d13570df', 'request_id': 'req-ebcdf190-47d4-4e24-bb38-960fe462746b'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.482558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] The token cache is being invalidate because project fbd1d04529bf48f598cfe9a2d13570df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:48.483500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.485304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ebcdf190-47d4-4e24-bb38-960fe462746b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.489442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1086/2172] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:48 2022] DELETE /identity/v3/projects/fbd1d04529bf48f598cfe9a2d13570df => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:48.493481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:48.507028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad164d33-5724-47d8-a618-4a4940b3397c service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:48.577882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:48.578944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:48.579335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:48.579722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] PATH_INFO: `/v3/users/8f3ce8da554c4441abd755c948db6055` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:48.582254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f3ce8da554c4441abd755c948db6055)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:48.584652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:48.716024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:48.820348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f3ce8da554c4441abd755c948db6055'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.912002 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f3ce8da554c4441abd755c948db6055'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.924848 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f3ce8da554c4441abd755c948db6055'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.932103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f3ce8da554c4441abd755c948db6055'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.932897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f3ce8da554c4441abd755c948db6055'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:48.940438 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1087/2173] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:48 2022] DELETE /identity/v3/users/8f3ce8da554c4441abd755c948db6055 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:49.097800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.098186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.098617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.117766 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:49.119001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:49.124731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:49.207004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1087/2174] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 2 13:55:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:49.221441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:49.223651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:49.298735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ca77f-5bfb-45b3-bc6e-9d3491d0ba93 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:49.304575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:49.305222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.305506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.305785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.315470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:49.318422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:49.329019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1088/2175] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:55:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:55:49.444696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:49.444696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:49.524840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f84b3-6ff7-4468-9a01-717ae804257b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:49.529381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:49.530336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.530643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.530922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] PATH_INFO: `/v3/projects/522ec371da0d4f1f9d6f4e41f21c0d3c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.532085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522ec371da0d4f1f9d6f4e41f21c0d3c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:49.534020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:49.642729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:49.644447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:49.664263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e8550-236a-4073-b7fa-762379714001 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:49.676117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522ec371da0d4f1f9d6f4e41f21c0d3c', 'request_id': 'req-10744b5a-723d-4cc8-b496-a284c6a519f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:49.691813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522ec371da0d4f1f9d6f4e41f21c0d3c', 'request_id': 'req-10744b5a-723d-4cc8-b496-a284c6a519f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:49.754898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:49.755777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.756061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.756387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] PATH_INFO: `/v3/users/0c13b5b0f561481bb487a63363a9c116` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.757696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c13b5b0f561481bb487a63363a9c116)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:49.759794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:49.792944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522ec371da0d4f1f9d6f4e41f21c0d3c', 'request_id': 'req-10744b5a-723d-4cc8-b496-a284c6a519f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:49.811712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] The token cache is being invalidate because project 522ec371da0d4f1f9d6f4e41f21c0d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:49.812004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:49.813465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10744b5a-723d-4cc8-b496-a284c6a519f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:49.817239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1088/2176] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:49 2022] DELETE /identity/v3/projects/522ec371da0d4f1f9d6f4e41f21c0d3c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:49.822315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305172-3d22-4cf9-bd40-d30e8ee2c088 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.822607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305172-3d22-4cf9-bd40-d30e8ee2c088 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.822888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4305172-3d22-4cf9-bd40-d30e8ee2c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.843167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e4305172-3d22-4cf9-bd40-d30e8ee2c088 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:49.844374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e4305172-3d22-4cf9-bd40-d30e8ee2c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:49.853797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1089/2177] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:49.861435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a8abb-3ba7-45e1-901b-623d5c1bd080 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.863379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a8abb-3ba7-45e1-901b-623d5c1bd080 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.865004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a8abb-3ba7-45e1-901b-623d5c1bd080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.890192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-830a8abb-3ba7-45e1-901b-623d5c1bd080 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:49.891458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-830a8abb-3ba7-45e1-901b-623d5c1bd080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:49.905629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1090/2178] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:49.911206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a8abb-3ba7-45e1-901b-623d5c1bd080 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:49.922264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a8abb-3ba7-45e1-901b-623d5c1bd080 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:49.928198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:49.928922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.929213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.929496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.930286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:49.930579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:49.932199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:49.948933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1091/2179] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:49.950207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:49.962059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ca0ff-4ed0-4c03-b630-74c929dee49a admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:49.967727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:49.968719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:49.968969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:49.969267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:49.969940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:49.972026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:49.992606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:50.001936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c13b5b0f561481bb487a63363a9c116'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:50.083225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1092/2180] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:49 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:50.087342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:50.108299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c13b5b0f561481bb487a63363a9c116'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:50.131300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c13b5b0f561481bb487a63363a9c116'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:50.150924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c13b5b0f561481bb487a63363a9c116'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:50.151775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aeefd3bf-5df2-4c85-94de-ef95a2cb174b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c13b5b0f561481bb487a63363a9c116'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:50.164054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1089/2181] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:49 2022] DELETE /identity/v3/users/0c13b5b0f561481bb487a63363a9c116 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:50.168633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf0726-afd7-461f-b0c3-f8b1d8d57b22 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.168633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf0726-afd7-461f-b0c3-f8b1d8d57b22 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.168633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf0726-afd7-461f-b0c3-f8b1d8d57b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.212887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e805c3b-b8f1-4e98-ace0-f79e9532f552 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:50.217495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-4ecf0726-afd7-461f-b0c3-f8b1d8d57b22 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:50.218840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4ecf0726-afd7-461f-b0c3-f8b1d8d57b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:50.293524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:50.312147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1090/2182] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:55:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:50.314298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.314797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.315278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.326283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:50.327843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.328213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.329342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.330562 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:50.335228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:50.352119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:50.353710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:50.362918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1091/2183] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:50.364711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:50.369851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:50.452267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e9e51-6135-420e-b453-d24c0e9e4284 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:50.459537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:50.460885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1093/2184] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:50 2022] POST /identity/v3/users => generated 282 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:50.461316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.461723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:50.461911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.462353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.468001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:50.475098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:50.476618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:50.492163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1092/2185] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:55:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:55:50.493141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:50.495143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:50.512529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c160d2-8652-49d5-95c3-14451694855c service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:50.518506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:50.519929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.519929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.520606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.521308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:50.522916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:50.533648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1093/2186] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:50.538180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:50.554466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3440b1c-b884-412a-9636-ae015431625e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:50.559881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:50.560746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.561072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.561356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.562148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:50.563770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:50.566807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89c9c4-a634-49c0-aa05-cacbc943b534 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:50.575840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2509d2d-8851-4c66-842a-3b6805197220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:50.576946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2509d2d-8851-4c66-842a-3b6805197220 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.577869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2509d2d-8851-4c66-842a-3b6805197220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.577869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2509d2d-8851-4c66-842a-3b6805197220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.590374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1094/2187] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:50.590743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2509d2d-8851-4c66-842a-3b6805197220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:50.592260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2509d2d-8851-4c66-842a-3b6805197220 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:50.594189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:50.602768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1094/2188] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:50.604509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6046e3a-e88a-4cf9-b0aa-4ec8e617d837 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:50.609411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:50.610347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.610636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.610918 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] PATH_INFO: `/v3/projects/75ee95d267db47cda87db1fd3c521084/users/ed8ba72fca9549ecbd61fb52c0f871e7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.632307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ee95d267db47cda87db1fd3c521084, user_id=ed8ba72fca9549ecbd61fb52c0f871e7, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:50.635602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:50.733012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1095/2189] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:50 2022] PUT /identity/v3/projects/75ee95d267db47cda87db1fd3c521084/users/ed8ba72fca9549ecbd61fb52c0f871e7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:50.746011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb585b0f-af44-4193-9fcc-9efd74af7c78 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:50.746869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb585b0f-af44-4193-9fcc-9efd74af7c78 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:50.748811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb585b0f-af44-4193-9fcc-9efd74af7c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:50.788932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-eb585b0f-af44-4193-9fcc-9efd74af7c78 None None] MFA Rules not processed for user `ed8ba72fca9549ecbd61fb52c0f871e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:50.790268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-eb585b0f-af44-4193-9fcc-9efd74af7c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:50.868450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1095/2190] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:50.885239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:50.887566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:51.001512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604dc144-be22-4b86-a089-36f8639f9069 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:51.006209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60649016-c4a4-44ce-9d78-1d2a413225ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:51.006870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649016-c4a4-44ce-9d78-1d2a413225ce service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:51.007313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649016-c4a4-44ce-9d78-1d2a413225ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:51.007610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60649016-c4a4-44ce-9d78-1d2a413225ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:51.018723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60649016-c4a4-44ce-9d78-1d2a413225ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:51.021363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60649016-c4a4-44ce-9d78-1d2a413225ce service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:51.033671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1096/2191] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:51.167186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072ca0e-18c8-4d99-83e7-9e3d4e4e0c2f None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:51.167528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072ca0e-18c8-4d99-83e7-9e3d4e4e0c2f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:51.167760 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9072ca0e-18c8-4d99-83e7-9e3d4e4e0c2f None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:51.172548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1096/2192] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:55:51.181520 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30414b98-9ff5-42cd-a331-84e3b34730ca None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:51.181884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30414b98-9ff5-42cd-a331-84e3b34730ca None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:51.182660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30414b98-9ff5-42cd-a331-84e3b34730ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:51.213026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:51.213323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:51.213609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:51.223422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-30414b98-9ff5-42cd-a331-84e3b34730ca None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:51.225579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-30414b98-9ff5-42cd-a331-84e3b34730ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:51.308948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] MFA Rules not processed for user `d4c0df21b3954b5d9dffd54643125817`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:51.313112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:51.313398 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1097/2193] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 2 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:51.325550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30414b98-9ff5-42cd-a331-84e3b34730ca None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:51.359877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:51.410627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30414b98-9ff5-42cd-a331-84e3b34730ca None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:51.416358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:51.417055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:51.417378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:51.417663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:51.427241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:51.428005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1097/2194] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:55:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:51.428880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:51.429223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:51.430554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:51.437838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1098/2195] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:55:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:55:51.445766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:51.447217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:51.516426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b640be-1818-4cf3-a2c5-fc44d1389bfd None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:51.521398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:51.522279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:51.522569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:51.522859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] PATH_INFO: `/v3/users/726a1e35b0ba437db464fbe108b0cd77` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:51.524180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] RBAC: Authorizing `identity:delete_user(user_id=726a1e35b0ba437db464fbe108b0cd77)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:51.526225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:51.538686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ad4a79-b655-4785-9942-00ccdab64c35 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:51.547417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:51.547417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:51.547417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:51.547417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] PATH_INFO: `/v3/projects/a1ec3ef23473420c8f1e5d432d441150` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:51.547796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ec3ef23473420c8f1e5d432d441150)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:51.548000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:51.979549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:51.993898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '726a1e35b0ba437db464fbe108b0cd77'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:51.995163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ec3ef23473420c8f1e5d432d441150', 'request_id': 'req-77de53e6-4b9f-4097-9075-5e47c0db2f11'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.002035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ec3ef23473420c8f1e5d432d441150', 'request_id': 'req-77de53e6-4b9f-4097-9075-5e47c0db2f11'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.107483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '726a1e35b0ba437db464fbe108b0cd77'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.141922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '726a1e35b0ba437db464fbe108b0cd77'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.152788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '726a1e35b0ba437db464fbe108b0cd77'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.153044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '726a1e35b0ba437db464fbe108b0cd77'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.161259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1098/2196] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:51 2022] DELETE /identity/v3/users/726a1e35b0ba437db464fbe108b0cd77 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:52.162843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:52.164233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:52.215329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ec3ef23473420c8f1e5d432d441150', 'request_id': 'req-77de53e6-4b9f-4097-9075-5e47c0db2f11'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.240392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] The token cache is being invalidate because project a1ec3ef23473420c8f1e5d432d441150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:52.241147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.242141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.244221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1099/2197] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:51 2022] DELETE /identity/v3/projects/a1ec3ef23473420c8f1e5d432d441150 => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:52.248334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:52.256284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:52.321366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d0054-6437-40ca-adb7-af521eafe991 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:52.344680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:52.345475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:52.345630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:52.346086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:52.353540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:52.373713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:52.373713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:52.384893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1099/2198] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:52.422575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de53e6-4b9f-4097-9075-5e47c0db2f11 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:52.541384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:52.543498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:52.543498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:52.543498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] PATH_INFO: `/v3/users/a6362c81681c4861a9e57b490512e3f3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:52.544531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6362c81681c4861a9e57b490512e3f3)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:52.546731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:52.790228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6362c81681c4861a9e57b490512e3f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.898286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6362c81681c4861a9e57b490512e3f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.911012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:52.913063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6362c81681c4861a9e57b490512e3f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.914255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:52.922085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6362c81681c4861a9e57b490512e3f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.923068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4a586b14-1c94-4b9f-b12c-ee39c6398a69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6362c81681c4861a9e57b490512e3f3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:52.936695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1100/2199] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:52 2022] DELETE /identity/v3/users/a6362c81681c4861a9e57b490512e3f3 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:52.946108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e31485-b8bb-4573-9e13-a8d753a74bc5 service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:53.053560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:53.055967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.055967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.055967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] PATH_INFO: `/v3/projects/50e9456d87f7446593f2e09b71de4c61` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.057330 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e9456d87f7446593f2e09b71de4c61)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:53.059463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:53.220231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e9456d87f7446593f2e09b71de4c61', 'request_id': 'req-2b8496c7-9e54-4247-aced-19122ae8d20c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.232647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e9456d87f7446593f2e09b71de4c61', 'request_id': 'req-2b8496c7-9e54-4247-aced-19122ae8d20c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.347942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e9456d87f7446593f2e09b71de4c61', 'request_id': 'req-2b8496c7-9e54-4247-aced-19122ae8d20c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.370904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] The token cache is being invalidate because project 50e9456d87f7446593f2e09b71de4c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:53.371452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.372768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-2b8496c7-9e54-4247-aced-19122ae8d20c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.381125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1100/2200] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:52 2022] DELETE /identity/v3/projects/50e9456d87f7446593f2e09b71de4c61 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:53.385576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782913-b0ae-4d04-866b-5a1fb9a8c14c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.386664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782913-b0ae-4d04-866b-5a1fb9a8c14c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.386664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3782913-b0ae-4d04-866b-5a1fb9a8c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.420668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e3782913-b0ae-4d04-866b-5a1fb9a8c14c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:53.422477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e3782913-b0ae-4d04-866b-5a1fb9a8c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:53.457754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:53.507344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1101/2201] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:53.515254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2e91-9b38-4f5e-a00f-a22c01b47177 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.515489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2e91-9b38-4f5e-a00f-a22c01b47177 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.515784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322f2e91-9b38-4f5e-a00f-a22c01b47177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.534442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-322f2e91-9b38-4f5e-a00f-a22c01b47177 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:53.536336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-322f2e91-9b38-4f5e-a00f-a22c01b47177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:53.544877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1101/2202] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:53.549162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3782913-b0ae-4d04-866b-5a1fb9a8c14c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:53.558858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3782913-b0ae-4d04-866b-5a1fb9a8c14c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:53.563867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:53.564572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.564861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.565145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.566456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:53.566773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:53.568471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:53.580621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1102/2203] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:53.585959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2e91-9b38-4f5e-a00f-a22c01b47177 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:53.596661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322f2e91-9b38-4f5e-a00f-a22c01b47177 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:53.601887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:53.607162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.607162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.607162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.607162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:53.607162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:53.649524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:53.669943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:53.671759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:53.685453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b17508-62b7-4a9e-b45b-21eadd8a5d75 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:53.690457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:53.691892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.692358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.692674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] PATH_INFO: `/v3/projects/f0b13dbef59a4974b39ee5c1b169e81a` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.693935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b13dbef59a4974b39ee5c1b169e81a)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:53.695867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:53.735825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1102/2204] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:53 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:53.737457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:53.833412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2e0c3-aa3d-46c8-a33d-ead5c0b5a6e2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:53.835563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b13dbef59a4974b39ee5c1b169e81a', 'request_id': 'req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.844230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b13dbef59a4974b39ee5c1b169e81a', 'request_id': 'req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.911635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a06dbc-fdc2-43a7-b5f9-5c98f7f858ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:53.912317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06dbc-fdc2-43a7-b5f9-5c98f7f858ea admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.912637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06dbc-fdc2-43a7-b5f9-5c98f7f858ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.912922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a06dbc-fdc2-43a7-b5f9-5c98f7f858ea admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.913622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a06dbc-fdc2-43a7-b5f9-5c98f7f858ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:53.915667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a06dbc-fdc2-43a7-b5f9-5c98f7f858ea admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:53.930257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b13dbef59a4974b39ee5c1b169e81a', 'request_id': 'req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.942216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] The token cache is being invalidate because project f0b13dbef59a4974b39ee5c1b169e81a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:53.942420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.943134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:53.944737 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1103/2205] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:53 2022] DELETE /identity/v3/projects/f0b13dbef59a4974b39ee5c1b169e81a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:53.945585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:53.946912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:53.959841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2396d0-569c-4a31-b0bd-ee5cd8bc1472 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:53.964559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:53.965417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:53.965700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:53.965977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] PATH_INFO: `/v3/users/bc199810e9d04a5b87de196d3ff089f7` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:53.967190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc199810e9d04a5b87de196d3ff089f7)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:53.969159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.032450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1103/2206] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:53 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:54.034384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.035298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.035720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.054535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:54.055737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:54.063670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1104/2207] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:54.064668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.072075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:54.086311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cdc49-d68f-42bc-8a26-4bf172d93f71 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.091033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921355cc-fd4e-4693-b7e2-1518e1954383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.091911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921355cc-fd4e-4693-b7e2-1518e1954383 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.092197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921355cc-fd4e-4693-b7e2-1518e1954383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.092535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921355cc-fd4e-4693-b7e2-1518e1954383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.093285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921355cc-fd4e-4693-b7e2-1518e1954383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.094887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921355cc-fd4e-4693-b7e2-1518e1954383 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.112758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1105/2208] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:54.115137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04709a-2bf4-402e-96ce-88c0392467f4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.115629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04709a-2bf4-402e-96ce-88c0392467f4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.116113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04709a-2bf4-402e-96ce-88c0392467f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.145506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5b04709a-2bf4-402e-96ce-88c0392467f4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:54.146415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5b04709a-2bf4-402e-96ce-88c0392467f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:54.158880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1106/2209] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:54.168436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04709a-2bf4-402e-96ce-88c0392467f4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.173149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04709a-2bf4-402e-96ce-88c0392467f4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.179216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.179905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.180190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.180500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.181233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.182859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.183854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc199810e9d04a5b87de196d3ff089f7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.198836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1107/2210] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:54.200106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.211377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954f0e2-6576-4d22-822f-869cda0209c4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.216434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.216892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.217174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.217474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.218193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:54.218496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.220109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.233797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1108/2211] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:54.234602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.246143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8878a3-5639-4001-b2b4-b3478edf628e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.250909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058fd38-bd53-4221-b9e9-7d151462d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.251781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058fd38-bd53-4221-b9e9-7d151462d50b admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.252071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058fd38-bd53-4221-b9e9-7d151462d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.252358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058fd38-bd53-4221-b9e9-7d151462d50b admin admin] PATH_INFO: `/v3/projects/8f72940f7df74b898595c0ed9c654502/users/b8d05eeb8ac146969b99d33084f1664c/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.267389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058fd38-bd53-4221-b9e9-7d151462d50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f72940f7df74b898595c0ed9c654502, user_id=b8d05eeb8ac146969b99d33084f1664c, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.271124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058fd38-bd53-4221-b9e9-7d151462d50b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.278040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc199810e9d04a5b87de196d3ff089f7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.291843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc199810e9d04a5b87de196d3ff089f7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.298654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc199810e9d04a5b87de196d3ff089f7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.299403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc199810e9d04a5b87de196d3ff089f7'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.305824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1104/2212] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:53 2022] DELETE /identity/v3/users/bc199810e9d04a5b87de196d3ff089f7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:54.306558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.307870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:54.386225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ecbca9-6e54-4623-8495-33c3b6e18e60 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.393164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.395540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.395896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.396360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.397762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.400381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.426020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1109/2213] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:54 2022] PUT /identity/v3/projects/8f72940f7df74b898595c0ed9c654502/users/b8d05eeb8ac146969b99d33084f1664c/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:54.430832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.431131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.431424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.450692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:54.451925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:54.542391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1110/2214] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:54.553391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:54.561535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1105/2215] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:54 2022] POST /identity/v3/projects => generated 393 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:54.563088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.564776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:54.567835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.643677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad04fc5-d6c8-494f-ad1a-c9176a799a2a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.645031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6279856-715a-42f2-acc3-97a2b4162156 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.648347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.649241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.649529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.652712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.653736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.656085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.692784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.693428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.693711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.693988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.703254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.704724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.714378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1111/2216] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:55:54.715185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.716608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:54.730264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad865ecd-7eaf-4999-9c94-32e6278cd6ef service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.735496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.738363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.738363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.738363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] PATH_INFO: `/v3/projects/916f67361ebf4aa7afbfad991a853a7c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.738737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] RBAC: Authorizing `identity:delete_project(project_id=916f67361ebf4aa7afbfad991a853a7c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.741198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.767347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1106/2217] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:54 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:54.768520 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.778839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9ec13f-83d6-485d-bb75-37d4c70ebbf8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.783735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.784428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.785442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.785875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.786621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.788232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.798718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1107/2218] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:54.805666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.817239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155277f8-9c6a-43f1-bd43-5f660ee77b47 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.821954 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.822647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.822935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.823218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.823941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.825835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.836803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1108/2219] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:54.840891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.852091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd3339-a715-46f2-a063-ceb0a1e27d1a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:54.870883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519d782-bbc1-40dc-ac42-416b357bc5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:54.871805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519d782-bbc1-40dc-ac42-416b357bc5a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.872097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519d782-bbc1-40dc-ac42-416b357bc5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.872381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519d782-bbc1-40dc-ac42-416b357bc5a2 admin admin] PATH_INFO: `/v3/projects/77c12d10002c410bbb7f43176b8df5fd/users/4cc7ee71966e421caa6a6c105b215ab8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.888806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916f67361ebf4aa7afbfad991a853a7c', 'request_id': 'req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.890428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519d782-bbc1-40dc-ac42-416b357bc5a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77c12d10002c410bbb7f43176b8df5fd, user_id=4cc7ee71966e421caa6a6c105b215ab8, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:54.894513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519d782-bbc1-40dc-ac42-416b357bc5a2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:54.901666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916f67361ebf4aa7afbfad991a853a7c', 'request_id': 'req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.969633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:54.974802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916f67361ebf4aa7afbfad991a853a7c', 'request_id': 'req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.978472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1109/2220] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:54 2022] PUT /identity/v3/projects/77c12d10002c410bbb7f43176b8df5fd/users/4cc7ee71966e421caa6a6c105b215ab8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:54.986349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] The token cache is being invalidate because project 916f67361ebf4aa7afbfad991a853a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:54.986637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.987340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:54.989699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1112/2221] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:54 2022] DELETE /identity/v3/projects/916f67361ebf4aa7afbfad991a853a7c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:54.992555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:54.992555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:54.992555 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:54.993681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:54.994983 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:55.016939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] MFA Rules not processed for user `4cc7ee71966e421caa6a6c105b215ab8`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:55.018153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:55.072453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c4c7c-7416-43d5-82e2-38d7ee7e730f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:55.141687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1110/2222] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:55.142650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:55.146445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:55.172756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:55.172756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:55.172756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:55.172756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] PATH_INFO: `/v3/users/949b6b828bfc478f980f56ce355087f4` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:55.173135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=949b6b828bfc478f980f56ce355087f4)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:55.173765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:55.238799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade1117-031f-4a5b-aeca-55805c7787c7 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:55.243487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:55.244473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:55.244820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:55.245171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] PATH_INFO: `/v3/users/65aafb8e5b564f6894cb49f2de27d4d0` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:55.246482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65aafb8e5b564f6894cb49f2de27d4d0)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:55.248518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:55.481348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949b6b828bfc478f980f56ce355087f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.577530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65aafb8e5b564f6894cb49f2de27d4d0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.597864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949b6b828bfc478f980f56ce355087f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.611291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949b6b828bfc478f980f56ce355087f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.618152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949b6b828bfc478f980f56ce355087f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.618844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949b6b828bfc478f980f56ce355087f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.625104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1113/2223] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:54 2022] DELETE /identity/v3/users/949b6b828bfc478f980f56ce355087f4 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:55.625879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:55.627409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:55.699948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f69ac-fca9-4d83-b77a-c134dea8c9de admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:55.705710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:55.707072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:55.708045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:55.708045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:55.708658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:55.710606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:55.735341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65aafb8e5b564f6894cb49f2de27d4d0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.749809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65aafb8e5b564f6894cb49f2de27d4d0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.759042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65aafb8e5b564f6894cb49f2de27d4d0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.760452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d6033d5-81a9-4d4c-acff-7392ab7d9b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65aafb8e5b564f6894cb49f2de27d4d0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:55.767683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1111/2224] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:55:55 2022] DELETE /identity/v3/users/65aafb8e5b564f6894cb49f2de27d4d0 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:55.772877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:55.773174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:55.773457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:55.793454 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:55.794586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:55.817231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1114/2225] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:55 2022] POST /identity/v3/projects => generated 393 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:55.821005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:55.823008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:55.875455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1112/2226] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:55.885799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:55.887374 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:55.897620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda18a3a-0914-45d3-bbcf-3bd890e37723 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:55.902525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:55.903199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:55.903497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:55.903836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:55.904643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:55.906657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:55.970701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920254e-e280-4212-a97c-37ba1825bf10 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.014744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1115/2227] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:55 2022] POST /identity/v3/users => generated 303 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:56.016736 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.019617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.028860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.029515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.029837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.030120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.032439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f076e-88f3-4cee-a294-ed06ffc0d55b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.037372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.038233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.038528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.038814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] PATH_INFO: `/v3/projects/6678a6f4e142482a92a36580a833efa7` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.039748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.039990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6678a6f4e142482a92a36580a833efa7)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.041218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.042045 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.051444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1113/2228] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:55:56.052272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.061923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09d96f-2931-436b-aae2-cda6738ac134 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.067019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.067677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.067961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.068238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.068993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.070877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.081970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1114/2229] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:56.086348 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.097300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d726330-47ab-4e60-85ac-4647844fee4d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.102323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.103232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.103528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.103813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] PATH_INFO: `/v3/projects/728d18f209164463b1f1b28478a1c5ff/users/e49ed8331dfa43a997282e251f0e5ea4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.120177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=728d18f209164463b1f1b28478a1c5ff, user_id=e49ed8331dfa43a997282e251f0e5ea4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.122934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.236428 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1115/2230] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:56 2022] PUT /identity/v3/projects/728d18f209164463b1f1b28478a1c5ff/users/e49ed8331dfa43a997282e251f0e5ea4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:56.240529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.245519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6678a6f4e142482a92a36580a833efa7', 'request_id': 'req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.255714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6678a6f4e142482a92a36580a833efa7', 'request_id': 'req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.318499 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d8d932-65c2-43ef-a8a5-1cb77e0ac8a7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.323593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.324427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.325042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.325387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.326228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.334265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.346161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1116/2231] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:56.357233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.367854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a416bd-03fa-4759-adc0-ed0e369462aa admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.372660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.373540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.373830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.374112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] PATH_INFO: `/v3/projects/728d18f209164463b1f1b28478a1c5ff/users/e49ed8331dfa43a997282e251f0e5ea4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.376108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] RBAC: Authorizing `identity:create_grant(project_id=728d18f209164463b1f1b28478a1c5ff, user_id=e49ed8331dfa43a997282e251f0e5ea4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.379445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.402184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1117/2232] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:56 2022] PUT /identity/v3/projects/728d18f209164463b1f1b28478a1c5ff/users/e49ed8331dfa43a997282e251f0e5ea4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:55:56.402184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.404578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.409696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6678a6f4e142482a92a36580a833efa7', 'request_id': 'req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.426720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] The token cache is being invalidate because project 6678a6f4e142482a92a36580a833efa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:56.428143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.429158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4d96aa1d-1ebb-4b5e-a8a9-a219a6b11f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.430793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1116/2233] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:56 2022] DELETE /identity/v3/projects/6678a6f4e142482a92a36580a833efa7 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:56.436276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768844f-d7f1-4cd6-8f8c-ac2c9f822c71 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.436276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768844f-d7f1-4cd6-8f8c-ac2c9f822c71 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.436276 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768844f-d7f1-4cd6-8f8c-ac2c9f822c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.472384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c768844f-d7f1-4cd6-8f8c-ac2c9f822c71 None None] MFA Rules not processed for user `e49ed8331dfa43a997282e251f0e5ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:56.473943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c768844f-d7f1-4cd6-8f8c-ac2c9f822c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.523277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c333d-0892-45a5-b87f-417b47bb322c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.528821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.529687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.529982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.530265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] PATH_INFO: `/v3/projects/0d6b4382cb104dde8ef340d6cf4f3037` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.532253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6b4382cb104dde8ef340d6cf4f3037)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.535074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.565345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1117/2234] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:56.567085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.567470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.567849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.595114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:56.596620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.616728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1118/2235] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:56.616728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.616728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.678230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6b4382cb104dde8ef340d6cf4f3037', 'request_id': 'req-da587441-db93-4536-bddb-e7ecf8ad3b68'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.687177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6b4382cb104dde8ef340d6cf4f3037', 'request_id': 'req-da587441-db93-4536-bddb-e7ecf8ad3b68'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.704832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7b0f6-1bc5-4ad0-8e68-ddf3cd532007 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.763529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b92853-0902-4f1d-846c-048d713883a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.764190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92853-0902-4f1d-846c-048d713883a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.764519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92853-0902-4f1d-846c-048d713883a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.764804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b92853-0902-4f1d-846c-048d713883a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.820497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6b4382cb104dde8ef340d6cf4f3037', 'request_id': 'req-da587441-db93-4536-bddb-e7ecf8ad3b68'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.830873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b92853-0902-4f1d-846c-048d713883a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:56.832996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b92853-0902-4f1d-846c-048d713883a9 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:56.833536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] The token cache is being invalidate because project 0d6b4382cb104dde8ef340d6cf4f3037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:55:56.834077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.834811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-da587441-db93-4536-bddb-e7ecf8ad3b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:55:56.841580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1118/2236] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:55:56 2022] DELETE /identity/v3/projects/0d6b4382cb104dde8ef340d6cf4f3037 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:56.841580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023ddbb-f9ce-4587-9fef-2973cee8e331 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.841580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023ddbb-f9ce-4587-9fef-2973cee8e331 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.841580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023ddbb-f9ce-4587-9fef-2973cee8e331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.844194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1119/2237] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:56.845701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.846003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.846284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.863994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c023ddbb-f9ce-4587-9fef-2973cee8e331 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:56.865515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c023ddbb-f9ce-4587-9fef-2973cee8e331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.867138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:56.868381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.953296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1120/2238] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:56.954585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:56.956176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.963933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1119/2239] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:56.965687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec76c9-e450-4a8c-9447-1366e6eb55bb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.966128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec76c9-e450-4a8c-9447-1366e6eb55bb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.971895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec76c9-e450-4a8c-9447-1366e6eb55bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.972149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70754b-bf81-460f-a0a1-e5730bc5b1cb None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:56.977770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:56.978384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:56.978677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:56.978961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:56.983546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:56.999015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7aec76c9-e450-4a8c-9447-1366e6eb55bb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:57.002998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7aec76c9-e450-4a8c-9447-1366e6eb55bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:57.009423 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1120/2240] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:55:57.013405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec76c9-e450-4a8c-9447-1366e6eb55bb None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.025544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec76c9-e450-4a8c-9447-1366e6eb55bb None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.032641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.034123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.034612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.034979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.035801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:57.036765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.040060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.054548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.055863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1121/2241] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:57.056945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.057161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.072146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1121/2242] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:57.073378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.088443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e323b6d-e847-40b1-ac56-9247bef7db7f service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.090710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d89e-0a6d-4911-a1a2-6f20f253a548 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.096711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:57.103592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.104284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.104670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.104961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.105898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.106650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.106954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.107336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.108042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.109700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:55:57.110072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.112756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.114950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.133891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1122/2243] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:55:57.138799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.150279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed9e6b-7cc5-4968-a113-39ba3a0b3bc9 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.155547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.158272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.158272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.158272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.158272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.161040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.215940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1122/2244] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:57 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:57.219383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.272909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1123/2245] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:55:57 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:57.275705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.360559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439421fe-e3ab-42b6-8c10-131d2f8f2ede admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.430366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ac67c-09d3-4a7e-bce2-efdec7d48616 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.446488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.447260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.449371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.449993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.450798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.453672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.501294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.502007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.502292 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.509054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.509054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.509054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.672557 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:55:57.672763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1124/2247] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:57 2022] POST /identity/v3/users => generated 289 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:55:57.672869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1123/2247] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:55:57 2022] POST /identity/v3/users => generated 286 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:55:57.676181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.678160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.690307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560399a7-e6f0-4f4d-8971-550c2e1412c8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.697140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.697957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.698407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.698790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.700780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.702197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.717431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1125/2248] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:55:57.717871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4465a-d8f5-4ffb-a506-57402558cbd4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.718980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.725417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.726212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.726506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.726844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.727632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.729469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.743598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cdad-621b-4b73-98e8-05a64436c16f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.747809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1124/2249] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:57.753108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.755332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.756308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.756792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.757149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.758700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.761925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.775673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5278eb-9155-48d1-b555-0aea772d31c9 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.785220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.785220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.785220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.785220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.785764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.787128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.791763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1126/2250] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:57.796323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.798823 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1125/2251] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:55:57.810257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:57.810812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c2ee3-9867-45ff-add1-46b76d7215ae admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.820936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33280b-db24-4ef3-be5c-5e4e13088b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.821491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33280b-db24-4ef3-be5c-5e4e13088b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.821773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33280b-db24-4ef3-be5c-5e4e13088b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.822063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33280b-db24-4ef3-be5c-5e4e13088b22 admin admin] PATH_INFO: `/v3/projects/c5c02b70c6fa4d4b999cca3d9f6154c5/users/198160f6a7524bbb9f90798d2269db00/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.822548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c21830-1249-4c21-a042-30c9d4244c74 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:57.828059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84c28b-98f3-410a-8c15-1b6f914c21a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:57.829052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c28b-98f3-410a-8c15-1b6f914c21a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:57.829408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c28b-98f3-410a-8c15-1b6f914c21a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:57.829762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84c28b-98f3-410a-8c15-1b6f914c21a7 admin admin] PATH_INFO: `/v3/projects/b55a34a53b2740d9af5efd660424a456/users/315c0d9d9a284389ae07bf898c330605/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:57.838048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33280b-db24-4ef3-be5c-5e4e13088b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c02b70c6fa4d4b999cca3d9f6154c5, user_id=198160f6a7524bbb9f90798d2269db00, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.840842 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33280b-db24-4ef3-be5c-5e4e13088b22 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:57.849539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84c28b-98f3-410a-8c15-1b6f914c21a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55a34a53b2740d9af5efd660424a456, user_id=315c0d9d9a284389ae07bf898c330605, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:57.851650 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84c28b-98f3-410a-8c15-1b6f914c21a7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:58.010609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1127/2252] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:57 2022] PUT /identity/v3/projects/c5c02b70c6fa4d4b999cca3d9f6154c5/users/198160f6a7524bbb9f90798d2269db00/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:58.015517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:58.015815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:58.016225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:58.035837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1126/2253] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:55:57 2022] PUT /identity/v3/projects/b55a34a53b2740d9af5efd660424a456/users/315c0d9d9a284389ae07bf898c330605/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:55:58.048985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:58.049390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:58.049681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:58.051863 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:58.053660 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:58.100047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:55:58.101349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:58.207975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1128/2254] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:58.217699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1127/2255] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:55:58.237105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:58.237270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:55:58.238951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:58.239074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:55:58.369761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b7d93-5741-4b2b-89db-84d9105012ca None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:58.377412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2fbc5-06d3-4c31-9cfd-59f762648a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:58.380724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fbc5-06d3-4c31-9cfd-59f762648a4e service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:58.383554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fbc5-06d3-4c31-9cfd-59f762648a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:58.383948 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2fbc5-06d3-4c31-9cfd-59f762648a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:58.402597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f6ed1-26af-4506-a821-46163cae98dc None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:55:58.402597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:55:58.402597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:55:58.402597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:55:58.403337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:55:58.411843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2fbc5-06d3-4c31-9cfd-59f762648a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:58.413622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2fbc5-06d3-4c31-9cfd-59f762648a4e service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:58.421558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:55:58.421558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:55:58.426186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1129/2256] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:58.431497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1128/2257] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:55:59.914761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:00.766506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:02.780491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:02.781042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:02.781042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:02.825406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] MFA Rules not processed for user `b8d05eeb8ac146969b99d33084f1664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:02.826845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:02.918716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1130/2258] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:02.936804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:02.938459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:03.023238 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:03.140481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fdacd-95b4-425c-b355-29fc87bb8ae4 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:03.149473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:03.156179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4369bc9-df01-4e50-9e0e-d08d65dbca0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:03.157081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4369bc9-df01-4e50-9e0e-d08d65dbca0b service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:03.159218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4369bc9-df01-4e50-9e0e-d08d65dbca0b service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:03.159218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4369bc9-df01-4e50-9e0e-d08d65dbca0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:03.171007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4369bc9-df01-4e50-9e0e-d08d65dbca0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:03.172935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4369bc9-df01-4e50-9e0e-d08d65dbca0b service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:03.184705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1129/2259] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:56:05.545932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:05.548043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:05.572696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c04be22-c1bd-4bb7-b06d-45f79815c448 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:05.586512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:05.587775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:05.588314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:05.588820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] PATH_INFO: `/v3/users/4cc7ee71966e421caa6a6c105b215ab8` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:05.591697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc7ee71966e421caa6a6c105b215ab8)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:05.598550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:05.855437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:05.882077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc7ee71966e421caa6a6c105b215ab8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:05.920253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:05.960843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc7ee71966e421caa6a6c105b215ab8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:05.985937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc7ee71966e421caa6a6c105b215ab8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:06.004111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc7ee71966e421caa6a6c105b215ab8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:06.005704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc7ee71966e421caa6a6c105b215ab8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:06.025043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1131/2260] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:05 2022] DELETE /identity/v3/users/4cc7ee71966e421caa6a6c105b215ab8 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:06.029241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:06.029899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:06.030209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:06.083257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:06.085968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:06.214876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1130/2261] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:06.229793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:06.231360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:06.306504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b145420-c984-4400-9bcf-047514e7e03b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:06.315118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:06.316487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:06.316763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:06.317632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:06.336849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:06.338240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:06.357371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1132/2262] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:07.162223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:07.166424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:07.217646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09dc2e-fac9-467b-8f59-6ac5b1ac719e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:07.224310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:07.228489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:07.229490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:07.229787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] PATH_INFO: `/v3/projects/77c12d10002c410bbb7f43176b8df5fd` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:07.232994 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77c12d10002c410bbb7f43176b8df5fd)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:07.240995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:07.458918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77c12d10002c410bbb7f43176b8df5fd', 'request_id': 'req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:07.471869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77c12d10002c410bbb7f43176b8df5fd', 'request_id': 'req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:07.542927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77c12d10002c410bbb7f43176b8df5fd', 'request_id': 'req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:07.575587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] The token cache is being invalidate because project 77c12d10002c410bbb7f43176b8df5fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:07.581626 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:07.582510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-bc0bc8ab-c8d5-4af9-b805-7f9183226ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:07.589482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1131/2263] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:07 2022] DELETE /identity/v3/projects/77c12d10002c410bbb7f43176b8df5fd => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:07.590829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:07.607763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54dfeab-e12a-4866-b613-eccd462195c1 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:07.661937 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:07.720260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:07.757372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:07.761981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:07.762531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:07.763019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] PATH_INFO: `/v3/users/e49ed8331dfa43a997282e251f0e5ea4` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:07.765857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49ed8331dfa43a997282e251f0e5ea4)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:07.775064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:08.054777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49ed8331dfa43a997282e251f0e5ea4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:08.125928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49ed8331dfa43a997282e251f0e5ea4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:08.151367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49ed8331dfa43a997282e251f0e5ea4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:08.161816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49ed8331dfa43a997282e251f0e5ea4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:08.163377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49ed8331dfa43a997282e251f0e5ea4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:08.177361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1133/2264] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:07 2022] DELETE /identity/v3/users/e49ed8331dfa43a997282e251f0e5ea4 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:08.954964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:09.104381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:09.149506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2fec-db53-4d24-a6d8-02e515d449a2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:09.149802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2fec-db53-4d24-a6d8-02e515d449a2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:09.150083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2fec-db53-4d24-a6d8-02e515d449a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:09.195565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-721a2fec-db53-4d24-a6d8-02e515d449a2 None None] MFA Rules not processed for user `b8d05eeb8ac146969b99d33084f1664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:09.199912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-721a2fec-db53-4d24-a6d8-02e515d449a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:09.342963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:09.344616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:09.352455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1132/2265] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:09.528325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c93088-677e-456b-bbce-604705ae2920 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:09.540026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:09.542324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:09.543406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:09.543927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] PATH_INFO: `/v3/projects/728d18f209164463b1f1b28478a1c5ff` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:09.546107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=728d18f209164463b1f1b28478a1c5ff)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:09.549195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:09.552811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9053063-85e5-46da-882b-923796faf67f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:09.553108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9053063-85e5-46da-882b-923796faf67f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:09.553489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9053063-85e5-46da-882b-923796faf67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:09.618449 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a9053063-85e5-46da-882b-923796faf67f None None] MFA Rules not processed for user `315c0d9d9a284389ae07bf898c330605`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:09.620101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a9053063-85e5-46da-882b-923796faf67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:09.776098 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '728d18f209164463b1f1b28478a1c5ff', 'request_id': 'req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:09.798981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '728d18f209164463b1f1b28478a1c5ff', 'request_id': 'req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:09.836198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1133/2266] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:09.855684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9053063-85e5-46da-882b-923796faf67f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:09.855684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a9053063-85e5-46da-882b-923796faf67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:09.867720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9053063-85e5-46da-882b-923796faf67f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:09.934192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:09.971339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '728d18f209164463b1f1b28478a1c5ff', 'request_id': 'req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:10.002478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] The token cache is being invalidate because project 728d18f209164463b1f1b28478a1c5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:10.002478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:10.002478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e5ff54c9-09d0-41c5-94bc-6f12cd138bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:10.014836 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1134/2267] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:09 2022] DELETE /identity/v3/projects/728d18f209164463b1f1b28478a1c5ff => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:10.022965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a5f5-e60f-486a-87c4-ce17983093b2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.023269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a5f5-e60f-486a-87c4-ce17983093b2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.023556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a8a5f5-e60f-486a-87c4-ce17983093b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.076066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-98a8a5f5-e60f-486a-87c4-ce17983093b2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:10.078702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-98a8a5f5-e60f-486a-87c4-ce17983093b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:10.101196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442dedc-3236-4e80-8fe9-a7cb78c62cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:10.102127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442dedc-3236-4e80-8fe9-a7cb78c62cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.102420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442dedc-3236-4e80-8fe9-a7cb78c62cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.106632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442dedc-3236-4e80-8fe9-a7cb78c62cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.106953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442dedc-3236-4e80-8fe9-a7cb78c62cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:10.119321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442dedc-3236-4e80-8fe9-a7cb78c62cb4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:10.265875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1135/2268] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:10.268197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fa64-02cc-438e-a2a1-7ad53260c147 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.273975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fa64-02cc-438e-a2a1-7ad53260c147 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.273975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144fa64-02cc-438e-a2a1-7ad53260c147 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.273975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1136/2269] 10.222.0.33 () {54 vars in 912 bytes} [Thu Jun 2 13:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:56:10.273975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaf542-3ca4-4362-94c1-93bb39926d2b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.274971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaf542-3ca4-4362-94c1-93bb39926d2b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.275449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdaf542-3ca4-4362-94c1-93bb39926d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.298182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1134/2270] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:09 2022] POST /identity/v3/projects => generated 379 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:10.299693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.302841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.303287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.347849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-dbdaf542-3ca4-4362-94c1-93bb39926d2b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:10.352752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] MFA Rules not processed for user `d7b2b76c46b640c0b19b46ed50d333ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:10.353344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-dbdaf542-3ca4-4362-94c1-93bb39926d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:10.355256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:10.457485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1135/2271] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:10.458463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:10.460916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:10.497782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:10.511211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1137/2272] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:10.513632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.514166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.515034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.571154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] MFA Rules not processed for user `198160f6a7524bbb9f90798d2269db00`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:10.572582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:10.587308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f0d5a-aaba-4b6a-a1d9-7afd93f7f18d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:10.609263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:10.609957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.610243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.610592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.611210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:10.613790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:10.646589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:10.664545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1138/2273] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:10.668133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:10.669119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:10.688518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd22bbb-2924-44ca-97df-bc5914a4d1d3 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:10.694195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:10.694868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.695260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.695540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.712115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1136/2274] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:10 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:10.712115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:10.720076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:10.721590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:10.736627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d53524-6b9c-416b-8622-68ee757721ac admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:10.739826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1139/2275] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:10.740758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:10.743394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:10.746077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:10.746756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.747098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.747384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.748131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:10.748830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:10.750105 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:10.789878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afec7b0-35c6-4daf-8d6d-61f1ddb7856a service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:10.792552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1137/2276] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:10.793560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:10.810421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:10.813107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.813413 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.813702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.814429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:10.818544 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:10.826354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead7039-1982-4881-8fa6-d40328e1014b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:10.842018 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:10.842708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.843180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.843469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.844217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:10.845915 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:10.879992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1138/2277] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:10.880190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:10.901809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ca65e-f103-4888-9d50-74841c635de8 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:10.906921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:10.907604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:10.907891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:10.908174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:10.909005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:10.911666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:10.959375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1140/2278] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:10 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:10.959375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.005026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1139/2279] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:10 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:11.008956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.173047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388296b-0685-454a-9720-4c7b2ecf77c1 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.203165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dd59a-ae1c-46de-9e41-77d54d93092c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.209290 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.210245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.210685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.211745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.212706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.214830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.291020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.291931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.292767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.293058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] PATH_INFO: `/v3/projects/a39a4a9273514013bedc7ea4e4a2b2b9/users/9ea80c41499244179f5e2c6530a1af08/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.322952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39a4a9273514013bedc7ea4e4a2b2b9, user_id=9ea80c41499244179f5e2c6530a1af08, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.326340 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.378802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1140/2280] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:11 2022] POST /identity/v3/users => generated 293 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:11.379638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.398683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8517d-0122-494c-aca0-bc2635e2f738 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.407469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:11.411388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.418472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1141/2281] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:10 2022] PUT /identity/v3/projects/a39a4a9273514013bedc7ea4e4a2b2b9/users/9ea80c41499244179f5e2c6530a1af08/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:11.420297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.421646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.422086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.424249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.425154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.431775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.544705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f700e9-b685-4983-8602-9fba3312899b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.550345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.551437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.551732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.552015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.553148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.556297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.581658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1141/2282] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:11 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:11.582887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.587103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1142/2283] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:11.590816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.610127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eca4a-d81d-4e17-a3fc-1bbfd87b8c3c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.618971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d098560-3eeb-4b4c-a670-c394dbb400bc admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.624924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.629932 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.630232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.630571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.631470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.633279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.634071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.636642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.637139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.637622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.638684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.640604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.653536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1143/2284] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:11.655738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.668647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1142/2285] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:11.672388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.688866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868fa3e8-ad22-4142-aaf2-016e97e6f2fd admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.694460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.705495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.705495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.705495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] PATH_INFO: `/v3/projects/37641ac36b3e453db0cedf861cc761b8/users/151a5bcf77bb442883631963a47cfb15/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.707102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a4c7a-c3e7-4997-b0e2-963387ebca3b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.707102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.707102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.707102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.707445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.707445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.708059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.724705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1143/2286] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:11.728578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:11.729610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37641ac36b3e453db0cedf861cc761b8, user_id=151a5bcf77bb442883631963a47cfb15, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.732878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.734573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.766249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721194d-d177-48b9-8ddc-0f29fdf74be3 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.766249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.766249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.766249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.766657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] PATH_INFO: `/v3/projects/a39a4a9273514013bedc7ea4e4a2b2b9/users/9ea80c41499244179f5e2c6530a1af08/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.768017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39a4a9273514013bedc7ea4e4a2b2b9, user_id=9ea80c41499244179f5e2c6530a1af08, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.772573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.784999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1144/2287] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:11 2022] PUT /identity/v3/projects/a39a4a9273514013bedc7ea4e4a2b2b9/users/9ea80c41499244179f5e2c6530a1af08/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:11.788697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.819383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1144/2288] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:11 2022] PUT /identity/v3/projects/37641ac36b3e453db0cedf861cc761b8/users/151a5bcf77bb442883631963a47cfb15/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:11.838031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:11.974303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a5ffb-4266-437d-a2c2-4530bf60b187 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:11.982897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:11.983856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:11.984524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:11.984524 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:11.986221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:11.989773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:11.992832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b8af6-fd9c-4519-a13f-38f54c3e0470 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:12.005950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:12.014350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:12.014350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:12.014350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] PATH_INFO: `/v3/projects/4a14331847e84c6d8710c672d9e61ea9/users/b1d5c0a2406d4b929e950772966f88e8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:12.014792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1145/2289] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:12.014792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:12.028384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fefd5-3f97-48b1-a826-04ca7ff6491d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:12.046126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f06478-c7f3-4628-92db-3a666f90446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:12.046963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06478-c7f3-4628-92db-3a666f90446d admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:12.048659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06478-c7f3-4628-92db-3a666f90446d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:12.049036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f06478-c7f3-4628-92db-3a666f90446d admin admin] PATH_INFO: `/v3/projects/37641ac36b3e453db0cedf861cc761b8/users/151a5bcf77bb442883631963a47cfb15/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:12.051831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f06478-c7f3-4628-92db-3a666f90446d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37641ac36b3e453db0cedf861cc761b8, user_id=151a5bcf77bb442883631963a47cfb15, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:12.055888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f06478-c7f3-4628-92db-3a666f90446d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:12.057065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a14331847e84c6d8710c672d9e61ea9, user_id=b1d5c0a2406d4b929e950772966f88e8, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:12.061017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:12.076886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1146/2290] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:12 2022] PUT /identity/v3/projects/37641ac36b3e453db0cedf861cc761b8/users/151a5bcf77bb442883631963a47cfb15/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:12.171497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1145/2291] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:11 2022] PUT /identity/v3/projects/4a14331847e84c6d8710c672d9e61ea9/users/b1d5c0a2406d4b929e950772966f88e8/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:12.184291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612bc1-f96a-421b-a2f2-c60ff9880ab0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:12.184652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612bc1-f96a-421b-a2f2-c60ff9880ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:12.184905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd612bc1-f96a-421b-a2f2-c60ff9880ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:12.252243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-fd612bc1-f96a-421b-a2f2-c60ff9880ab0 None None] MFA Rules not processed for user `b1d5c0a2406d4b929e950772966f88e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:12.264564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-fd612bc1-f96a-421b-a2f2-c60ff9880ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:12.458093 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1147/2292] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:12.471053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:12.473765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:12.620889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60ab1-3d58-4248-9183-359b894b4a34 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:12.629286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ebd06c-e88e-45c7-b9b0-907a3acc5eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:12.629968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd06c-e88e-45c7-b9b0-907a3acc5eed service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:12.630388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd06c-e88e-45c7-b9b0-907a3acc5eed service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:12.630952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ebd06c-e88e-45c7-b9b0-907a3acc5eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:12.673095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd06c-e88e-45c7-b9b0-907a3acc5eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:12.675050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ebd06c-e88e-45c7-b9b0-907a3acc5eed service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:12.717015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1146/2293] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:12.731016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd612bc1-f96a-421b-a2f2-c60ff9880ab0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:12.852594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd612bc1-f96a-421b-a2f2-c60ff9880ab0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:12.853616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:12.857897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:12.859888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:12.863759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] PATH_INFO: `/v3/users/b1d5c0a2406d4b929e950772966f88e8` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:12.866628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d5c0a2406d4b929e950772966f88e8)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:12.869824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:13.154962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d5c0a2406d4b929e950772966f88e8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:13.312572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d5c0a2406d4b929e950772966f88e8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:13.371506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d5c0a2406d4b929e950772966f88e8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:13.385725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d5c0a2406d4b929e950772966f88e8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:13.387010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d5c0a2406d4b929e950772966f88e8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:13.406682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1148/2294] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:12 2022] DELETE /identity/v3/users/b1d5c0a2406d4b929e950772966f88e8 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:13.412855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:13.412855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:13.412855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:13.452904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:13.460850 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:13.598328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1147/2295] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:13.615853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:13.623536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:13.707653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0d94d-02ec-49d2-9307-cbc7765ea95f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:13.711608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f10616-c47c-4b5f-a493-024e259796c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:13.712341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10616-c47c-4b5f-a493-024e259796c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:13.712798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10616-c47c-4b5f-a493-024e259796c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:13.712936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f10616-c47c-4b5f-a493-024e259796c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:13.731311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f10616-c47c-4b5f-a493-024e259796c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:13.732875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f10616-c47c-4b5f-a493-024e259796c9 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:13.744112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1149/2296] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:13.755009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:14.172904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:14.487862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:14.489569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:14.508547 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30ce5d-9601-4fae-9bd6-c69b0c728bcd None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:14.515334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:14.520324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:14.520934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:14.521711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] PATH_INFO: `/v3/projects/4a14331847e84c6d8710c672d9e61ea9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:14.523932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a14331847e84c6d8710c672d9e61ea9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:14.528778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:14.684918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a14331847e84c6d8710c672d9e61ea9', 'request_id': 'req-7077cd56-9f60-4866-898b-74dcc494981c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:14.709774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a14331847e84c6d8710c672d9e61ea9', 'request_id': 'req-7077cd56-9f60-4866-898b-74dcc494981c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:14.815229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a14331847e84c6d8710c672d9e61ea9', 'request_id': 'req-7077cd56-9f60-4866-898b-74dcc494981c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:14.830655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] The token cache is being invalidate because project 4a14331847e84c6d8710c672d9e61ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:14.831096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:14.832701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7077cd56-9f60-4866-898b-74dcc494981c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:14.834801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1148/2297] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:14 2022] DELETE /identity/v3/projects/4a14331847e84c6d8710c672d9e61ea9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:14.840294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a3aaf-22ec-480e-a5f3-0b6a249eb0c0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:14.840867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a3aaf-22ec-480e-a5f3-0b6a249eb0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:14.841132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a3aaf-22ec-480e-a5f3-0b6a249eb0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:14.860857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c78a3aaf-22ec-480e-a5f3-0b6a249eb0c0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:14.862215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c78a3aaf-22ec-480e-a5f3-0b6a249eb0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:14.938553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1150/2298] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:14.946505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98fb0-bd4b-4008-a927-8eb276a46f6d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:14.947061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98fb0-bd4b-4008-a927-8eb276a46f6d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:14.947594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab98fb0-bd4b-4008-a927-8eb276a46f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:14.971568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2ab98fb0-bd4b-4008-a927-8eb276a46f6d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:14.973321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2ab98fb0-bd4b-4008-a927-8eb276a46f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:14.989954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1149/2299] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:14.993363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a3aaf-22ec-480e-a5f3-0b6a249eb0c0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:15.008655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a3aaf-22ec-480e-a5f3-0b6a249eb0c0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:15.024999 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:15.026302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:15.026750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:15.027186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:15.028478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:15.028951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:15.031075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:15.051792 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1151/2300] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:15.056059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98fb0-bd4b-4008-a927-8eb276a46f6d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:15.071510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab98fb0-bd4b-4008-a927-8eb276a46f6d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:15.077191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:15.077889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:15.078218 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:15.078505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:15.079534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:15.082818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:15.234692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1150/2301] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:15 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:56:15.239381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:15.250284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e4f0e-515a-4f9f-969a-314a55455b0c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:15.334897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:15.335706 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:15.336064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:15.336437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:15.337228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:15.339318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:15.521298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1152/2302] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:15 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:15.521399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:15.535900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65e382-d341-4b14-9f0a-d40bd49cf3e2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:15.546415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:15.549528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:15.549528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:15.549528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:15.549528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:15.553989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:15.575662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1151/2303] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:15.579723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:15.615855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248d7c6-3f12-47ae-8531-e428b5909759 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:15.623076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b60c1-068a-44f1-8b2f-c0cd7f367011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:15.634152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b60c1-068a-44f1-8b2f-c0cd7f367011 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:15.634502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b60c1-068a-44f1-8b2f-c0cd7f367011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:15.634698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b60c1-068a-44f1-8b2f-c0cd7f367011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:15.635521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b60c1-068a-44f1-8b2f-c0cd7f367011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:15.637886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b60c1-068a-44f1-8b2f-c0cd7f367011 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:15.668341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1153/2304] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:15.670912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:15.681560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d93c7-5bbe-4a83-ad7b-1337a77854a3 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:15.701681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:15.703311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:15.703748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:15.704803 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] PATH_INFO: `/v3/projects/b58bc96d9cf24194a1f9479364a8eeb3/users/a298b599d41f47dc92e0e738ace471a9/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:15.731088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58bc96d9cf24194a1f9479364a8eeb3, user_id=a298b599d41f47dc92e0e738ace471a9, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:15.733857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:15.843506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1152/2305] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:15 2022] PUT /identity/v3/projects/b58bc96d9cf24194a1f9479364a8eeb3/users/a298b599d41f47dc92e0e738ace471a9/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:15.854819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cadef-48d1-408c-a54c-5d685732255a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:15.855388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cadef-48d1-408c-a54c-5d685732255a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:15.855388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cadef-48d1-408c-a54c-5d685732255a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:15.885373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-8b5cadef-48d1-408c-a54c-5d685732255a None None] MFA Rules not processed for user `a298b599d41f47dc92e0e738ace471a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:15.886608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8b5cadef-48d1-408c-a54c-5d685732255a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:15.997870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:16.000296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1154/2306] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:16.013549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:16.101874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd8cdc-b146-4a8f-bcfa-2d1058cf1b8c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:16.122293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:16.122991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:16.123279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:16.128349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:16.128349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:16.128349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:16.282497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1153/2307] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:16 2022] POST /identity/v3/projects => generated 377 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:16.297902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cadef-48d1-408c-a54c-5d685732255a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:16.314900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:16.333223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cadef-48d1-408c-a54c-5d685732255a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:16.423347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:16.424228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:16.424812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:16.427192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:16.429309 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:16.431727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:16.553120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1155/2308] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:16 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:16.556225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:16.572552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e072c9-49dc-41f1-af3e-2e9bbc52a8da admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:16.586890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:16.587595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:16.587888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:16.588171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:16.589189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:16.591020 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:16.621597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1154/2309] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:16.622030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:16.635516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8c706-8581-4d67-ad66-9372f8df3292 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:16.644383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926b180-c1cb-4add-8d33-96535e21f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:16.645131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926b180-c1cb-4add-8d33-96535e21f6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:16.645543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926b180-c1cb-4add-8d33-96535e21f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:16.645873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926b180-c1cb-4add-8d33-96535e21f6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:16.646676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926b180-c1cb-4add-8d33-96535e21f6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:16.648383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926b180-c1cb-4add-8d33-96535e21f6d2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:16.663208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1156/2310] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:16.667496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:16.678306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898db3f-7bfc-4bce-a523-744e490306bc admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:16.684453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:16.685620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:16.685908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:16.686192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] PATH_INFO: `/v3/projects/b1c63509e7e441d0aa086882c62ae7e0/users/05c20b39cf4a4110bc4c442885d5c844/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:16.704938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c63509e7e441d0aa086882c62ae7e0, user_id=05c20b39cf4a4110bc4c442885d5c844, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:16.709025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:16.788200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1155/2311] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:16 2022] PUT /identity/v3/projects/b1c63509e7e441d0aa086882c62ae7e0/users/05c20b39cf4a4110bc4c442885d5c844/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:16.816956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c8d7-ddde-413f-b65b-64871b99ee16 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:16.817144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c8d7-ddde-413f-b65b-64871b99ee16 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:16.817334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59c8d7-ddde-413f-b65b-64871b99ee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:16.845077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ba59c8d7-ddde-413f-b65b-64871b99ee16 None None] MFA Rules not processed for user `05c20b39cf4a4110bc4c442885d5c844`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:16.846447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ba59c8d7-ddde-413f-b65b-64871b99ee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:16.954285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1157/2312] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:16.955335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:17.051430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87e8e-f2e9-479b-8300-7ec9dd35d52e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:17.056642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:17.057542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:17.057833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:17.058120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:17.058822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:17.061879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:17.212714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:17.230099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59c8d7-ddde-413f-b65b-64871b99ee16 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:17.231014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1156/2313] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:16 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:56:17.242725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59c8d7-ddde-413f-b65b-64871b99ee16 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:17.389746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:17.391625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:17.392377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:17.392618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:17.396325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:17.404011 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:17.540134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1158/2314] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:17 2022] POST /identity/v3/users => generated 295 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:17.544605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:17.559040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291dc94-f41e-4e42-bd79-35c16044564f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:17.564364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:17.565129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:17.565416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:17.566375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:17.567459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:17.570621 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:17.574055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:17.585697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1157/2315] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:17.591816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:17.621731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd91b69-fe66-4287-9f8c-0a70eac01f9d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:17.634134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:17.635539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:17.636015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:17.636637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] PATH_INFO: `/v3/projects/185260ecb2584188b048192b7652c88b/users/d8bb3d2d45f842ecba1a0dad2c1400b0/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:17.667003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=185260ecb2584188b048192b7652c88b, user_id=d8bb3d2d45f842ecba1a0dad2c1400b0, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:17.673037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:17.788991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1159/2316] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:17 2022] PUT /identity/v3/projects/185260ecb2584188b048192b7652c88b/users/d8bb3d2d45f842ecba1a0dad2c1400b0/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:17.792832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:17.807091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c2d32-cbcc-437a-b412-911649f31164 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:17.936843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8668dc95-3245-426a-bd32-4fe80ab385d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:17.937683 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668dc95-3245-426a-bd32-4fe80ab385d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:17.937980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668dc95-3245-426a-bd32-4fe80ab385d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:17.938265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668dc95-3245-426a-bd32-4fe80ab385d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:17.939009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668dc95-3245-426a-bd32-4fe80ab385d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:17.941304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8668dc95-3245-426a-bd32-4fe80ab385d7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:17.964765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1158/2317] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:17.972968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:17.990455 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83c2df-dacf-47ce-8c99-9da56e0c9d5a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:18.009905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:18.012096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:18.012632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:18.013089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] PATH_INFO: `/v3/projects/185260ecb2584188b048192b7652c88b/users/d8bb3d2d45f842ecba1a0dad2c1400b0/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:18.020594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185260ecb2584188b048192b7652c88b, user_id=d8bb3d2d45f842ecba1a0dad2c1400b0, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:18.031165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:18.043748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1160/2318] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:17 2022] PUT /identity/v3/projects/185260ecb2584188b048192b7652c88b/users/d8bb3d2d45f842ecba1a0dad2c1400b0/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:18.054946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:18.065013 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:18.065314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:18.113753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] MFA Rules not processed for user `d8bb3d2d45f842ecba1a0dad2c1400b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:18.119705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:18.231500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1159/2319] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:18.245041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:18.246838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:18.348762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c824a6-6d0c-4cf2-9788-57fc1c2cf315 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:18.353522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:18.354260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:18.354816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:18.355319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:18.458770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:18.460856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:18.486645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1161/2320] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:18.686783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:19.114995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:21.455079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:21.898486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:21.900128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:22.021104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6973195-586e-4af2-8aee-56e4e0b6778f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:22.057052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:22.060677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:22.061795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:22.062982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] PATH_INFO: `/v3/users/b9bde55634d143248a0a42b6008185e6` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:22.074488 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9bde55634d143248a0a42b6008185e6)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:22.077943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:22.277344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:22.289613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07168e6d-f8a7-487c-8a05-1f33d6c601de service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:22.299072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab13ef-e992-4e75-950b-009d9d88ecb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:22.299878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab13ef-e992-4e75-950b-009d9d88ecb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:22.303067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab13ef-e992-4e75-950b-009d9d88ecb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:22.303486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab13ef-e992-4e75-950b-009d9d88ecb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:22.732097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9bde55634d143248a0a42b6008185e6'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:22.736741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab13ef-e992-4e75-950b-009d9d88ecb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:22.736741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab13ef-e992-4e75-950b-009d9d88ecb8 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:22.736741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1162/2321] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:22.895371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9bde55634d143248a0a42b6008185e6'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:22.907668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:22.928599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9bde55634d143248a0a42b6008185e6'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:22.937619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9bde55634d143248a0a42b6008185e6'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:22.938888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9bde55634d143248a0a42b6008185e6'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:22.950213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1160/2322] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:21 2022] DELETE /identity/v3/users/b9bde55634d143248a0a42b6008185e6 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:22.966372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8c08-d769-4607-a27c-c2106b8b47d6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:22.967146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8c08-d769-4607-a27c-c2106b8b47d6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:22.967807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dc8c08-d769-4607-a27c-c2106b8b47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:23.002089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-84dc8c08-d769-4607-a27c-c2106b8b47d6 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:23.003635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-84dc8c08-d769-4607-a27c-c2106b8b47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:23.146609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1163/2323] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:23.243504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:23.245154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:23.459539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d7c9-88ad-4f5f-8579-a3efe60dc9ae admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:23.463739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:23.465434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:23.465734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:23.466203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:23.495413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:23.497948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:23.556138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1161/2324] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:24.832086 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:24.832086 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:24.835157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:24.874493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:24.877305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:24.886062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] MFA Rules not processed for user `9ea80c41499244179f5e2c6530a1af08`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:24.889897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:24.901580 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aae1bd-3240-4b4f-882e-bd1e123658ba service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:24.914627 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:24.915708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:24.916004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:24.916291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] PATH_INFO: `/v3/projects/8566082fb08e4655b49d4fbb0de6990e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:24.919242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8566082fb08e4655b49d4fbb0de6990e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:24.923499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:24.990450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1164/2325] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:25.011471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:25.013282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:25.147440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8566082fb08e4655b49d4fbb0de6990e', 'request_id': 'req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:25.149388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08916bf5-4254-464e-9de9-ed2433039464 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:25.170159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8566082fb08e4655b49d4fbb0de6990e', 'request_id': 'req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:25.297487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8566082fb08e4655b49d4fbb0de6990e', 'request_id': 'req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:25.311654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5da25d-7439-4292-bc5f-9bb28959ac52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:25.312334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da25d-7439-4292-bc5f-9bb28959ac52 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:25.312650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da25d-7439-4292-bc5f-9bb28959ac52 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:25.313122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5da25d-7439-4292-bc5f-9bb28959ac52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:25.316543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0e5da25d-7439-4292-bc5f-9bb28959ac52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:25.317926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] The token cache is being invalidate because project 8566082fb08e4655b49d4fbb0de6990e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:25.319752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:25.322260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:25.334147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1162/2326] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:24 2022] DELETE /identity/v3/projects/8566082fb08e4655b49d4fbb0de6990e => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:25.336041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:25.337967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:25.430304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23ef8d-7d3f-4295-ac31-b0980426d8b0 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:25.438035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843eb72a-8923-40f1-ae76-8a8415c3d1e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:25.438035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb72a-8923-40f1-ae76-8a8415c3d1e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:25.438035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb72a-8923-40f1-ae76-8a8415c3d1e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:25.438035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843eb72a-8923-40f1-ae76-8a8415c3d1e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:25.438573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-843eb72a-8923-40f1-ae76-8a8415c3d1e0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:25.454399 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5da25d-7439-4292-bc5f-9bb28959ac52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:25.456066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5da25d-7439-4292-bc5f-9bb28959ac52 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:25.470205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1165/2327] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:25.473184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f13b-65a8-465b-aa21-d31cf24f957b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:25.473485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f13b-65a8-465b-aa21-d31cf24f957b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:25.473742 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46f13b-65a8-465b-aa21-d31cf24f957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:25.505363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0f46f13b-65a8-465b-aa21-d31cf24f957b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:25.506887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0f46f13b-65a8-465b-aa21-d31cf24f957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:25.650954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eb72a-8923-40f1-ae76-8a8415c3d1e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:25.661265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843eb72a-8923-40f1-ae76-8a8415c3d1e0 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:25.686938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1166/2328] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:25.688794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682adc1a-00c8-4a29-a4bf-6aed42f85a11 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:25.689175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682adc1a-00c8-4a29-a4bf-6aed42f85a11 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:25.689479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682adc1a-00c8-4a29-a4bf-6aed42f85a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:25.695663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1163/2329] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:25.771542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-682adc1a-00c8-4a29-a4bf-6aed42f85a11 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:25.771542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:25.771542 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-682adc1a-00c8-4a29-a4bf-6aed42f85a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:25.773039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:25.773257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1167/2330] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:25.773529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:25.773818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:25.774644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682adc1a-00c8-4a29-a4bf-6aed42f85a11 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:25.795683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682adc1a-00c8-4a29-a4bf-6aed42f85a11 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:25.809341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:25.810156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:25.810509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:25.810870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:25.811695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:56:25.812085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:25.813902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:25.827358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] MFA Rules not processed for user `151a5bcf77bb442883631963a47cfb15`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:25.832762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:25.839951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1168/2331] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:56:25.842106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:25.856575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b76636-17f5-430e-ae03-c1736b022dea admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:25.865050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:25.866226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:25.866731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:25.867477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:25.868550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:25.876768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:25.964115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1164/2332] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:25.975004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:25.977635 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:26.005012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5d87f9-a647-4e43-adec-9d9b1322d07a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:26.010936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:26.011815 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:26.012272 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:26.012738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:26.014709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:26.109762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1169/2333] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:56:25 2022] POST /identity/v3/projects => generated 369 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:26.113591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:26.113591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:26.116191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:26.132651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1165/2334] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:26.265744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef8515-5205-43c2-968c-ed49aa43660b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:26.270561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:26.271252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:26.271537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:26.271816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:26.272602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:26.274541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:26.396788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1170/2335] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:56:26 2022] POST /identity/v3/users => generated 285 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:56:26.400714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:26.413166 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795c4c8-11be-4144-b253-dc4a8d43e5b4 service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:26.418718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:26.420223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:26.420223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:26.420438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:26.421217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:26.423284 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:26.435320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1166/2336] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:26.439618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:26.452777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed80b8-1f26-454a-9438-4dc6db9a8fa2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:26.459579 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9612d7f-102d-4e13-9579-45b238c31687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:26.460598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612d7f-102d-4e13-9579-45b238c31687 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:26.460908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612d7f-102d-4e13-9579-45b238c31687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:26.461194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9612d7f-102d-4e13-9579-45b238c31687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:26.462113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612d7f-102d-4e13-9579-45b238c31687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:26.466037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9612d7f-102d-4e13-9579-45b238c31687 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:26.483819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1171/2337] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:56:26.485355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:26.503827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeb0184-09fe-4278-952a-f140c9a4f048 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:26.511728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:26.512755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:26.513134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:26.513708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] PATH_INFO: `/v3/projects/ea5c29f72ef4442da0050922e43a0946/users/6fcba3c3b08c4b29b123dfc577c5db7d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:26.546225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5c29f72ef4442da0050922e43a0946, user_id=6fcba3c3b08c4b29b123dfc577c5db7d, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:26.553010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:26.715328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1167/2338] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:56:26 2022] PUT /identity/v3/projects/ea5c29f72ef4442da0050922e43a0946/users/6fcba3c3b08c4b29b123dfc577c5db7d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:26.730739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f061c1-bbb5-4e46-b607-1189f446961b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:26.731041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f061c1-bbb5-4e46-b607-1189f446961b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:26.731344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f061c1-bbb5-4e46-b607-1189f446961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:26.777198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b3f061c1-bbb5-4e46-b607-1189f446961b None None] MFA Rules not processed for user `6fcba3c3b08c4b29b123dfc577c5db7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:26.778497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b3f061c1-bbb5-4e46-b607-1189f446961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:26.906396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1172/2339] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:26.919293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:26.929039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:27.067283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056eb9-064a-43d6-923d-6eaf008bcca3 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:27.073717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:27.074949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:27.075399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:27.075841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:27.105359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:27.106868 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:27.138696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1168/2340] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:27.515010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:28.828899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:30.245073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf534-f28a-4681-975a-d81429a306a6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:30.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf534-f28a-4681-975a-d81429a306a6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:30.245733 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cf534-f28a-4681-975a-d81429a306a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:30.266933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-973cf534-f28a-4681-975a-d81429a306a6 None None] MFA Rules not processed for user `198160f6a7524bbb9f90798d2269db00`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:30.268074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-973cf534-f28a-4681-975a-d81429a306a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:30.350988 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1173/2341] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:30.889732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:30.937452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:31.489223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:32.011693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:32.475560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:32.477201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:32.561093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa6d3-4fa6-41c0-be93-13742caf3e79 service glance] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:32.567382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:32.568278 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:32.568604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:32.568890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] PATH_INFO: `/v3/users/a298b599d41f47dc92e0e738ace471a9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:32.570119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a298b599d41f47dc92e0e738ace471a9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:32.572102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:32.810424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a298b599d41f47dc92e0e738ace471a9'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:32.888855 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a298b599d41f47dc92e0e738ace471a9'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:32.918811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a298b599d41f47dc92e0e738ace471a9'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:32.937196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a298b599d41f47dc92e0e738ace471a9'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:32.938217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a298b599d41f47dc92e0e738ace471a9'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:32.952750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1169/2342] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:32 2022] DELETE /identity/v3/users/a298b599d41f47dc92e0e738ace471a9 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:32.958694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:32.959232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:32.959629 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:32.981878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:32.983288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:33.060746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1174/2343] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:56:33.074417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:33.076811 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:33.083499 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:33.146660 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57904a82-dbf1-4d3e-bdc4-879de883a116 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:33.150496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:33.151146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:33.151472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:33.151869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:33.162664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:33.164098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:33.174681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1170/2344] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:56:33.929026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:33.929320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:33.942312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dcdd1e-1d60-4849-b0ac-ffa2f9c2df77 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:33.947212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:33.948111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:33.948415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:33.948719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] PATH_INFO: `/v3/projects/b58bc96d9cf24194a1f9479364a8eeb3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:33.950170 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58bc96d9cf24194a1f9479364a8eeb3)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:33.952085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:34.101634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58bc96d9cf24194a1f9479364a8eeb3', 'request_id': 'req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.108158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58bc96d9cf24194a1f9479364a8eeb3', 'request_id': 'req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.205482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58bc96d9cf24194a1f9479364a8eeb3', 'request_id': 'req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.219734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:34.223875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] The token cache is being invalidate because project b58bc96d9cf24194a1f9479364a8eeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:34.224179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.224892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-9cf82bde-9b2c-4fd8-8bf4-02aa5a03b45e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.226556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1175/2345] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:33 2022] DELETE /identity/v3/projects/b58bc96d9cf24194a1f9479364a8eeb3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:34.230593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:34.245896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cf12c-9a6d-4584-811a-2f9a97223ba4 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:34.310969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:34.312133 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:34.312595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:34.312984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] PATH_INFO: `/v3/users/05c20b39cf4a4110bc4c442885d5c844` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:34.314322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05c20b39cf4a4110bc4c442885d5c844)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:34.317027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:34.594489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05c20b39cf4a4110bc4c442885d5c844'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.714024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05c20b39cf4a4110bc4c442885d5c844'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.726802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05c20b39cf4a4110bc4c442885d5c844'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.733988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05c20b39cf4a4110bc4c442885d5c844'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.734773 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05c20b39cf4a4110bc4c442885d5c844'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:34.741161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1171/2346] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:34 2022] DELETE /identity/v3/users/05c20b39cf4a4110bc4c442885d5c844 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:34.758611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac99f0-ddc4-46ad-88ab-800deaa950b9 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:34.758835 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac99f0-ddc4-46ad-88ab-800deaa950b9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:34.759122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac99f0-ddc4-46ad-88ab-800deaa950b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:34.777407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-edac99f0-ddc4-46ad-88ab-800deaa950b9 None None] MFA Rules not processed for user `f9e57606c14a4ad99612414c1f9719f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:56:34.778616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-edac99f0-ddc4-46ad-88ab-800deaa950b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:34.848500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1176/2347] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:56:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:56:35.199227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:35.201136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:35.238689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:35.276929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35d408-39c6-4150-97b7-3f626a1e92b1 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:35.287761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:35.288696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:35.288986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:35.289268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] PATH_INFO: `/v3/projects/b1c63509e7e441d0aa086882c62ae7e0` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:35.290472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c63509e7e441d0aa086882c62ae7e0)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:35.292425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:35.429548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c63509e7e441d0aa086882c62ae7e0', 'request_id': 'req-d2fc8603-8277-403e-b059-57dc0b9d6d10'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.436943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c63509e7e441d0aa086882c62ae7e0', 'request_id': 'req-d2fc8603-8277-403e-b059-57dc0b9d6d10'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.514367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c63509e7e441d0aa086882c62ae7e0', 'request_id': 'req-d2fc8603-8277-403e-b059-57dc0b9d6d10'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.531839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] The token cache is being invalidate because project b1c63509e7e441d0aa086882c62ae7e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:35.532867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.532867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.537722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1172/2348] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:35 2022] DELETE /identity/v3/projects/b1c63509e7e441d0aa086882c62ae7e0 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:35.539073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac99f0-ddc4-46ad-88ab-800deaa950b9 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:35.555367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac99f0-ddc4-46ad-88ab-800deaa950b9 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:35.664655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:35.666657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:35.667246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:35.667841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] PATH_INFO: `/v3/users/d8bb3d2d45f842ecba1a0dad2c1400b0` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:35.669720 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8bb3d2d45f842ecba1a0dad2c1400b0)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:35.673415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:35.881931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8bb3d2d45f842ecba1a0dad2c1400b0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.959725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8bb3d2d45f842ecba1a0dad2c1400b0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.973907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8bb3d2d45f842ecba1a0dad2c1400b0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.981963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8bb3d2d45f842ecba1a0dad2c1400b0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.982840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8bb3d2d45f842ecba1a0dad2c1400b0'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:35.993787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1177/2349] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:56:35 2022] DELETE /identity/v3/users/d8bb3d2d45f842ecba1a0dad2c1400b0 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:36.512316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:36.514221 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:36.531144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc8603-8277-403e-b059-57dc0b9d6d10 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:36.623943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:36.626056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:36.626647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:36.627087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] PATH_INFO: `/v3/projects/185260ecb2584188b048192b7652c88b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:36.630780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=185260ecb2584188b048192b7652c88b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:36.632528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:36.757692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185260ecb2584188b048192b7652c88b', 'request_id': 'req-4c638239-fd90-4533-9c87-6e2d8c44e45f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:36.765819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185260ecb2584188b048192b7652c88b', 'request_id': 'req-4c638239-fd90-4533-9c87-6e2d8c44e45f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:36.891486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185260ecb2584188b048192b7652c88b', 'request_id': 'req-4c638239-fd90-4533-9c87-6e2d8c44e45f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:36.904043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] The token cache is being invalidate because project 185260ecb2584188b048192b7652c88b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:56:36.904341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:36.905512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:56:36.907016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1173/2350] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:56:36 2022] DELETE /identity/v3/projects/185260ecb2584188b048192b7652c88b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:56:37.791970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:46.397784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=78,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:49.039516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=3,keystone:SELECT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:56:55.599770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:56:55.601363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:55.701307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5731b-68fd-4874-83cd-9bb1325b3e18 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:56:55.770215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab29090-9cb3-4956-a946-a8c2c8f272da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:56:55.770869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab29090-9cb3-4956-a946-a8c2c8f272da service placement] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:56:55.771152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab29090-9cb3-4956-a946-a8c2c8f272da service placement] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:56:55.771425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab29090-9cb3-4956-a946-a8c2c8f272da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:56:55.773286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eab29090-9cb3-4956-a946-a8c2c8f272da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:56:55.785315 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab29090-9cb3-4956-a946-a8c2c8f272da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:56:55.786936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab29090-9cb3-4956-a946-a8c2c8f272da service placement] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:56:55.796773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1178/2351] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:56:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:05.792711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=58 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:19.455739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.457232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.521311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638239-fd90-4533-9c87-6e2d8c44e45f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:19.525900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:19.526756 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.527060 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.527337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] PATH_INFO: `/v3/users/ed8ba72fca9549ecbd61fb52c0f871e7` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.528550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8ba72fca9549ecbd61fb52c0f871e7)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:19.530503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:19.727075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8ba72fca9549ecbd61fb52c0f871e7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.827759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8ba72fca9549ecbd61fb52c0f871e7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.840993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8ba72fca9549ecbd61fb52c0f871e7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.849555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8ba72fca9549ecbd61fb52c0f871e7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.850275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8ba72fca9549ecbd61fb52c0f871e7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:19.856280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1174/2352] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:19 2022] DELETE /identity/v3/users/ed8ba72fca9549ecbd61fb52c0f871e7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:19.860938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04693409-d814-4692-8c34-e112869ee737 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:19.861418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04693409-d814-4692-8c34-e112869ee737 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:19.861502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04693409-d814-4692-8c34-e112869ee737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:19.881763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-04693409-d814-4692-8c34-e112869ee737 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:19.883081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-04693409-d814-4692-8c34-e112869ee737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:19.950989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1179/2353] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:19.961125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:19.962523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:20.018964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b69a6-3cd4-4cf0-9bf6-deecc1e4d1ab admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:20.022666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458977c5-22ba-4448-8331-7bd81c5fc5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:20.023299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458977c5-22ba-4448-8331-7bd81c5fc5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.023582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458977c5-22ba-4448-8331-7bd81c5fc5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.023860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458977c5-22ba-4448-8331-7bd81c5fc5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.032765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458977c5-22ba-4448-8331-7bd81c5fc5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:20.035194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458977c5-22ba-4448-8331-7bd81c5fc5f1 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:20.045578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1175/2354] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:20.469161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04693409-d814-4692-8c34-e112869ee737 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:20.470819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-04693409-d814-4692-8c34-e112869ee737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:20.494207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04693409-d814-4692-8c34-e112869ee737 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:20.494207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:20.494207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.494207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.494556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] PATH_INFO: `/v3/projects/75ee95d267db47cda87db1fd3c521084` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.494556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ee95d267db47cda87db1fd3c521084)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:20.494556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:20.615250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ee95d267db47cda87db1fd3c521084', 'request_id': 'req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.621488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ee95d267db47cda87db1fd3c521084', 'request_id': 'req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.702113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ee95d267db47cda87db1fd3c521084', 'request_id': 'req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.713277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] The token cache is being invalidate because project 75ee95d267db47cda87db1fd3c521084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:20.713569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.714204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-c2aa395e-ebe5-4b6d-bf8d-b214d1ea2768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:20.715763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1180/2355] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:20 2022] DELETE /identity/v3/projects/75ee95d267db47cda87db1fd3c521084 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:20.720747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131482e-890d-4941-9727-a21953f6bf79 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.721228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131482e-890d-4941-9727-a21953f6bf79 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.721385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8131482e-890d-4941-9727-a21953f6bf79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.740110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8131482e-890d-4941-9727-a21953f6bf79 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:20.741247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8131482e-890d-4941-9727-a21953f6bf79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:20.758456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:20.798725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1176/2356] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:20.807292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f997c-6c80-4d7c-9569-516937555b6d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.807683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f997c-6c80-4d7c-9569-516937555b6d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.807854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f997c-6c80-4d7c-9569-516937555b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.828975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e24f997c-6c80-4d7c-9569-516937555b6d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:20.830535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e24f997c-6c80-4d7c-9569-516937555b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:20.838665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1181/2357] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:20.844086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131482e-890d-4941-9727-a21953f6bf79 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:20.854405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8131482e-890d-4941-9727-a21953f6bf79 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:20.859089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:20.859971 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.860665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.861008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.861748 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:20.862079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:20.863689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:20.879406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1177/2358] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 13:57:20.881564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f997c-6c80-4d7c-9569-516937555b6d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:20.891058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f997c-6c80-4d7c-9569-516937555b6d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:20.896186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:20.896961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:20.897244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:20.897538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:20.898187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:20.900064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:20.982887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1182/2359] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:20 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:20.988132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:20.998233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b8b31-dc3c-4baa-b8c8-ffbdc60b91f0 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.055245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.055926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.056212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.056535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.057243 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.059197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.147944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1178/2360] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:20 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:21.152152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:21.163291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200edb8-993e-4946-b8f6-171254294341 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.168058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.168754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.169053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.169382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.170114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.171715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.183035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1183/2361] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:21.187140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:21.197975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d977c0b-ed4a-4d56-bcb7-21a09632cf0f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.203000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43bfc6-afdc-4931-b9ce-c57da810d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.203656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43bfc6-afdc-4931-b9ce-c57da810d0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.203990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43bfc6-afdc-4931-b9ce-c57da810d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.204266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43bfc6-afdc-4931-b9ce-c57da810d0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.205082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43bfc6-afdc-4931-b9ce-c57da810d0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.206685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43bfc6-afdc-4931-b9ce-c57da810d0e4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.217234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1179/2362] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 13:57:21.221159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:21.230907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a5fb0-6592-4a1a-887a-94925bd933c7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.235548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.243201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.243201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.243201 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] PATH_INFO: `/v3/projects/fcf40995eb41415f86eb21d2d90cad0c/users/67ff5bb9ea7744baa0e48e9d9bcaee9d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.251656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcf40995eb41415f86eb21d2d90cad0c, user_id=67ff5bb9ea7744baa0e48e9d9bcaee9d, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.254324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.408877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1184/2363] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:21 2022] PUT /identity/v3/projects/fcf40995eb41415f86eb21d2d90cad0c/users/67ff5bb9ea7744baa0e48e9d9bcaee9d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:21.419725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3bea-f23d-4a78-9ec5-6019a83a3725 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.420093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3bea-f23d-4a78-9ec5-6019a83a3725 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.420381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d3bea-f23d-4a78-9ec5-6019a83a3725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.448670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-588d3bea-f23d-4a78-9ec5-6019a83a3725 None None] MFA Rules not processed for user `67ff5bb9ea7744baa0e48e9d9bcaee9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:21.450141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-588d3bea-f23d-4a78-9ec5-6019a83a3725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:21.514341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1180/2364] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:21.524926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:21.526588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:21.548176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:21.583444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c5149-3d08-4ab9-8bf3-b9aed45becf8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:21.587155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:21.587800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:21.588085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:21.588362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:21.596728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:21.598632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:21.607295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1185/2365] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:31.511485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:31.665164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=17 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:34.683565 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445153-3136-432d-aa63-1d3b6346d4aa None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:34.684032 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445153-3136-432d-aa63-1d3b6346d4aa None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:34.684129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445153-3136-432d-aa63-1d3b6346d4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:34.706024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e6445153-3136-432d-aa63-1d3b6346d4aa None None] MFA Rules not processed for user `315c0d9d9a284389ae07bf898c330605`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:34.707320 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e6445153-3136-432d-aa63-1d3b6346d4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:34.769745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1181/2366] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:43.938619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:44.054042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedc7c1-73bf-494e-97fc-0ec69c7811ae service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:44.059882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:44.061038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:44.061343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:44.061802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] PATH_INFO: `/v3/users/67ff5bb9ea7744baa0e48e9d9bcaee9d` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:44.063198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=67ff5bb9ea7744baa0e48e9d9bcaee9d)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:44.065261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:44.299665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67ff5bb9ea7744baa0e48e9d9bcaee9d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.491030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67ff5bb9ea7744baa0e48e9d9bcaee9d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.506676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67ff5bb9ea7744baa0e48e9d9bcaee9d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.513946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67ff5bb9ea7744baa0e48e9d9bcaee9d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.514769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67ff5bb9ea7744baa0e48e9d9bcaee9d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:44.521670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1186/2367] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:43 2022] DELETE /identity/v3/users/67ff5bb9ea7744baa0e48e9d9bcaee9d => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:44.526092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:44.526604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:44.526703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:44.546187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:44.547754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:44.617343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1182/2368] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:44.636992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:44.640719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:44.716474 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b93d0e-33ce-4787-ac2e-2d4f7de84d5b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:44.720214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d74390-b512-48b1-af93-c87356d79d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:44.720910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74390-b512-48b1-af93-c87356d79d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:44.721202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74390-b512-48b1-af93-c87356d79d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:44.721486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74390-b512-48b1-af93-c87356d79d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:44.731449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d74390-b512-48b1-af93-c87356d79d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:44.732942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d74390-b512-48b1-af93-c87356d79d14 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:44.743444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1187/2369] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:45.251005 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:45.252438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:45.266001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3c1fe-8143-4dde-9d24-4c7b0e535108 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:45.273024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:45.273485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:45.273771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:45.274164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] PATH_INFO: `/v3/projects/fcf40995eb41415f86eb21d2d90cad0c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:45.277345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcf40995eb41415f86eb21d2d90cad0c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:45.279539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:45.472227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcf40995eb41415f86eb21d2d90cad0c', 'request_id': 'req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.488507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcf40995eb41415f86eb21d2d90cad0c', 'request_id': 'req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.634055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcf40995eb41415f86eb21d2d90cad0c', 'request_id': 'req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.648306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] The token cache is being invalidate because project fcf40995eb41415f86eb21d2d90cad0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:45.648790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.650361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-96d454c4-a2ec-4ceb-873a-36c7d034e0a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:45.665609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1183/2370] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:45 2022] DELETE /identity/v3/projects/fcf40995eb41415f86eb21d2d90cad0c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:45.667385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9ed1-4a48-4ac0-a420-e01631bd74bd None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:45.667834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9ed1-4a48-4ac0-a420-e01631bd74bd None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:45.668078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b9ed1-4a48-4ac0-a420-e01631bd74bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:45.694305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-720b9ed1-4a48-4ac0-a420-e01631bd74bd None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:45.696186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-720b9ed1-4a48-4ac0-a420-e01631bd74bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:45.722503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:45.788452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1188/2371] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:45.800624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4590c4-f747-4e68-a7f2-dc3af4f78daa None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:45.801172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4590c4-f747-4e68-a7f2-dc3af4f78daa None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:45.801510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4590c4-f747-4e68-a7f2-dc3af4f78daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:45.821964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5b4590c4-f747-4e68-a7f2-dc3af4f78daa None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:45.823247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5b4590c4-f747-4e68-a7f2-dc3af4f78daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:45.831724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1184/2372] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:45.836623 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9ed1-4a48-4ac0-a420-e01631bd74bd None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:45.846489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b9ed1-4a48-4ac0-a420-e01631bd74bd None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:45.851302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:45.852140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:45.852458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:45.852744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:45.853464 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:45.853772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:45.855427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:45.867025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1189/2373] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:45.871215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4590c4-f747-4e68-a7f2-dc3af4f78daa None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:45.882148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4590c4-f747-4e68-a7f2-dc3af4f78daa None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:45.887606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:45.888498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:45.888872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:45.889217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:45.889998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:45.892043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.005457 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:46.020645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1185/2374] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:45 2022] POST /identity/v3/projects => generated 399 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:46.022523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.037033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4f75-8ac9-4ecf-b87e-3c2b9486b83e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.139628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.140574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.140878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.141561 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.142301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.146728 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.239729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1190/2375] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:46 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:46.240424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.250614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504c7cf-54f2-4b5b-ac7f-0d7140cac625 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.256059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.256990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.257473 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.257912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.258807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.260646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.272961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1186/2376] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:46.276670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.289149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa3a5b2-9821-4556-8c0f-90c08dd7e1fe admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.293904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0956f-5229-4b9f-b5b0-099bd7526aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.294626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0956f-5229-4b9f-b5b0-099bd7526aff admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.295026 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0956f-5229-4b9f-b5b0-099bd7526aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.295312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0956f-5229-4b9f-b5b0-099bd7526aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.296187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0956f-5229-4b9f-b5b0-099bd7526aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.297832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0956f-5229-4b9f-b5b0-099bd7526aff admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.317603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1191/2377] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:46.320200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.335968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7467a827-c5b9-41e6-b46a-ae6962e051e1 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.343135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.344061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.344347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.344666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] PATH_INFO: `/v3/projects/73ecd44c2c87497786be7d73f62fc6b3/users/42d3185c1e484c36b76aaafb83e3c561/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.363168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ecd44c2c87497786be7d73f62fc6b3, user_id=42d3185c1e484c36b76aaafb83e3c561, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.367036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.466670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1187/2378] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:46 2022] PUT /identity/v3/projects/73ecd44c2c87497786be7d73f62fc6b3/users/42d3185c1e484c36b76aaafb83e3c561/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:46.541725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.542009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.542300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.582137 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] MFA Rules not processed for user `42d3185c1e484c36b76aaafb83e3c561`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:46.584859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.680016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1192/2379] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:46.692750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:46.694560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:46.760177 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d5833e-7502-4d8d-a2e6-8a6f4ba3fd91 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:46.763983 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e46e6a-ce9a-4d04-9ef7-1aba18d37f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:46.764694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e46e6a-ce9a-4d04-9ef7-1aba18d37f4a service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:46.764981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e46e6a-ce9a-4d04-9ef7-1aba18d37f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:46.765267 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e46e6a-ce9a-4d04-9ef7-1aba18d37f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:46.775838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e46e6a-ce9a-4d04-9ef7-1aba18d37f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:46.781075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e46e6a-ce9a-4d04-9ef7-1aba18d37f4a service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:46.787570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1188/2380] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:57:50.466272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:50.467931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:50.488322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:50.533925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d07dc1-4a3c-4f19-b919-2c83072383dc None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:50.538537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:50.539395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:50.539676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:50.539951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] PATH_INFO: `/v3/users/6fcba3c3b08c4b29b123dfc577c5db7d` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:50.541136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fcba3c3b08c4b29b123dfc577c5db7d)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:50.543041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:50.752309 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fcba3c3b08c4b29b123dfc577c5db7d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.839570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fcba3c3b08c4b29b123dfc577c5db7d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.853087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fcba3c3b08c4b29b123dfc577c5db7d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.860265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fcba3c3b08c4b29b123dfc577c5db7d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.861012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fcba3c3b08c4b29b123dfc577c5db7d'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:50.867682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1193/2381] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:50 2022] DELETE /identity/v3/users/6fcba3c3b08c4b29b123dfc577c5db7d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:50.876189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:50.876189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:50.876189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:50.893865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:50.895077 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:50.953699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1189/2382] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:50.963956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:50.965419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:51.023911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82441dc0-402e-4970-b9c0-333d978cdc5e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.027826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca1da0-67fe-49ce-9912-b041aadf1f01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.028503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1da0-67fe-49ce-9912-b041aadf1f01 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.028787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1da0-67fe-49ce-9912-b041aadf1f01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.029084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1da0-67fe-49ce-9912-b041aadf1f01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.039525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca1da0-67fe-49ce-9912-b041aadf1f01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.040991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca1da0-67fe-49ce-9912-b041aadf1f01 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.050839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1194/2383] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:51.560461 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:51.562612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:51.575260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c533e-9e89-4c4a-a006-8e20da345f2a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:51.579931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:51.580862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.581135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.581412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] PATH_INFO: `/v3/projects/ea5c29f72ef4442da0050922e43a0946` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.582593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5c29f72ef4442da0050922e43a0946)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:51.585090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:51.752037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5c29f72ef4442da0050922e43a0946', 'request_id': 'req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.758877 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5c29f72ef4442da0050922e43a0946', 'request_id': 'req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.867497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5c29f72ef4442da0050922e43a0946', 'request_id': 'req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.869750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:51.878846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] The token cache is being invalidate because project ea5c29f72ef4442da0050922e43a0946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:57:51.879435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.879776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6105dd4e-02a4-4f5a-9d22-1887f6fc680a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:57:51.882145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1190/2384] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:57:51 2022] DELETE /identity/v3/projects/ea5c29f72ef4442da0050922e43a0946 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:51.888280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1823a-07a9-4ce7-88b2-9c88a5fc9890 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.889013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1823a-07a9-4ce7-88b2-9c88a5fc9890 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.889342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee1823a-07a9-4ce7-88b2-9c88a5fc9890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:51.911242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-aee1823a-07a9-4ce7-88b2-9c88a5fc9890 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:51.915744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-aee1823a-07a9-4ce7-88b2-9c88a5fc9890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:51.951504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:51.978024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1195/2385] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:51.985917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7068ce-1a96-4462-b0c2-d6359f841bdb None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:51.986207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7068ce-1a96-4462-b0c2-d6359f841bdb None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:51.986485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7068ce-1a96-4462-b0c2-d6359f841bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.004842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-ac7068ce-1a96-4462-b0c2-d6359f841bdb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:52.007223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ac7068ce-1a96-4462-b0c2-d6359f841bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.015229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1191/2386] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:52.019688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1823a-07a9-4ce7-88b2-9c88a5fc9890 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.029385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee1823a-07a9-4ce7-88b2-9c88a5fc9890 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.034831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.035540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.042344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.042344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.042344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 13:57:52.042344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.042344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.051741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1196/2387] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 13:57:52.056211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7068ce-1a96-4462-b0c2-d6359f841bdb None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.065919 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7068ce-1a96-4462-b0c2-d6359f841bdb None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.071861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.072549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.072841 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.073121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.073822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.076094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.204316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1192/2388] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:52.208487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.218928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36f4b3-038e-4e78-a981-ed06618addda admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.278209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.278994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.279289 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.279585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.280279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.282456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.365130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1197/2389] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:52.369755 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.380233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421ef95-ff98-4917-95d6-31f677353dc9 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.385680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.386337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.386625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.386908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.387637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.389293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.401096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1193/2390] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:52.405284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.416028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16287a07-6572-404b-a346-5e645cceaef4 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.420821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596c4b1-af5b-41f5-a799-673a4599e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.421520 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c4b1-af5b-41f5-a799-673a4599e932 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.421755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c4b1-af5b-41f5-a799-673a4599e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.422037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596c4b1-af5b-41f5-a799-673a4599e932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.422762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c4b1-af5b-41f5-a799-673a4599e932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.424337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596c4b1-af5b-41f5-a799-673a4599e932 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.434664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1198/2391] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:52.439112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.449946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f981aab-be86-423a-9e0a-382731ff1062 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.454704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.455509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.455793 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.456072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] PATH_INFO: `/v3/projects/93c4473545ff46bbaa857263e85af2f1/users/3c80d109325d4a4b9e9e97dfaccc5785/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.472483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] RBAC: Authorizing `identity:create_grant(project_id=93c4473545ff46bbaa857263e85af2f1, user_id=3c80d109325d4a4b9e9e97dfaccc5785, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.475162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.548838 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1194/2392] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:52 2022] PUT /identity/v3/projects/93c4473545ff46bbaa857263e85af2f1/users/3c80d109325d4a4b9e9e97dfaccc5785/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:52.554277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28f69-8626-4a60-b005-e55cc55ea1c0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.554655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28f69-8626-4a60-b005-e55cc55ea1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.554952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28f69-8626-4a60-b005-e55cc55ea1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.574951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e2a28f69-8626-4a60-b005-e55cc55ea1c0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:52.576281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e2a28f69-8626-4a60-b005-e55cc55ea1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.637938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1199/2393] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:57:52.648010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:52.649759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:52.706757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb291c-6b37-46a3-8a01-93febdef829d admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:52.711022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:52.711666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:52.711949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:52.712227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:52.721352 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:52.722790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:52.732464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1195/2394] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:57:58.647905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f156c-fa1e-4b78-a369-6eb49ab4396b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.655263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f156c-fa1e-4b78-a369-6eb49ab4396b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.655263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f156c-fa1e-4b78-a369-6eb49ab4396b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.688250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-d02f156c-fa1e-4b78-a369-6eb49ab4396b None None] MFA Rules not processed for user `3c80d109325d4a4b9e9e97dfaccc5785`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:57:58.689699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d02f156c-fa1e-4b78-a369-6eb49ab4396b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:58.730295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:58.763770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1200/2395] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:57:58.768530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.780008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2004e-89ad-4807-a20a-e6a39bfb98d2 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.785066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.785786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.786135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.786492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.787340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.789433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:58.884685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1196/2396] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 13:57:58.888771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f156c-fa1e-4b78-a369-6eb49ab4396b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:58.899859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f156c-fa1e-4b78-a369-6eb49ab4396b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:58.960755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:58.961435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:58.961962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:58.962246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:58.962940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:58.964934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.052090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1201/2397] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 13:57:58 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 13:57:59.053575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.064472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaad677-26fe-4c59-98e0-7f2891f2d4bd admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.069885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.070563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.070849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.071155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.071856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.074289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.084989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1197/2398] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:59.089391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.099791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f30678-d84f-477f-855d-8f1544dfd03d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.104721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.105628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.105897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.106176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] PATH_INFO: `/v3/projects/7cce971099ae45d3b7ea8a76dc90472e/users/083b92ac8bf0405c80d53728c2d95a42/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.123070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cce971099ae45d3b7ea8a76dc90472e, user_id=083b92ac8bf0405c80d53728c2d95a42, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.126802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.241243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1202/2399] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:59 2022] PUT /identity/v3/projects/7cce971099ae45d3b7ea8a76dc90472e/users/083b92ac8bf0405c80d53728c2d95a42/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 13:57:59.243818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.253917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6aa82-9b44-4cf8-a327-7d6df6b7c793 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.309446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:57:59.315319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.315988 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.316294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.316590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.317322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.319078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.329318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1198/2400] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 13:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 13:57:59.333652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.368687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8af19f-4e10-42af-a69a-8c7a0aafa05d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.368687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355d7679-6915-447a-98aa-7d41379aadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.368687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7679-6915-447a-98aa-7d41379aadb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.368687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7679-6915-447a-98aa-7d41379aadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.373065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d7679-6915-447a-98aa-7d41379aadb9 admin admin] PATH_INFO: `/v3/projects/7cce971099ae45d3b7ea8a76dc90472e/users/083b92ac8bf0405c80d53728c2d95a42/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.373065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d7679-6915-447a-98aa-7d41379aadb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cce971099ae45d3b7ea8a76dc90472e, user_id=083b92ac8bf0405c80d53728c2d95a42, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.373065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355d7679-6915-447a-98aa-7d41379aadb9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.380423 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1203/2401] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 13:57:59 2022] PUT /identity/v3/projects/7cce971099ae45d3b7ea8a76dc90472e/users/083b92ac8bf0405c80d53728c2d95a42/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:57:59.642271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:57:59.644065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:57:59.663415 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288578d-b1b6-43a9-adbd-e56063ee06da admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:57:59.745527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:57:59.746464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:57:59.746757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:57:59.747041 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] PATH_INFO: `/v3/users/42d3185c1e484c36b76aaafb83e3c561` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:57:59.748575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d3185c1e484c36b76aaafb83e3c561)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:57:59.752980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:57:59.975920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d3185c1e484c36b76aaafb83e3c561'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:00.042400 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d3185c1e484c36b76aaafb83e3c561'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:00.059019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d3185c1e484c36b76aaafb83e3c561'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:00.067633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d3185c1e484c36b76aaafb83e3c561'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:00.069035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d3185c1e484c36b76aaafb83e3c561'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:00.079504 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1199/2402] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 13:57:59 2022] DELETE /identity/v3/users/42d3185c1e484c36b76aaafb83e3c561 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:00.081390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.081896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.082254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.102805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:00.103784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.166246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1204/2403] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:00.176581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:00.178651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:00.255916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1c49a-6007-4c0c-80bf-caf92e33f78c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:00.259824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1611f44a-62d8-4080-99da-f66a2b65de9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:00.260711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f44a-62d8-4080-99da-f66a2b65de9e service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:00.261000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f44a-62d8-4080-99da-f66a2b65de9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:00.261425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1611f44a-62d8-4080-99da-f66a2b65de9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:00.273359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611f44a-62d8-4080-99da-f66a2b65de9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:00.277669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1611f44a-62d8-4080-99da-f66a2b65de9e service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:00.304128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1200/2404] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:01.145411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:01.148069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:01.160826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c79cd-988f-48d2-b6a6-5b1c7ad27529 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:01.166302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:01.167179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:01.167472 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:01.167758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] PATH_INFO: `/v3/projects/73ecd44c2c87497786be7d73f62fc6b3` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:01.169020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ecd44c2c87497786be7d73f62fc6b3)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:01.170947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:01.196978 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:01.297237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ecd44c2c87497786be7d73f62fc6b3', 'request_id': 'req-d4cec706-dd17-4d52-aed0-bcc94029106c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:01.304614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ecd44c2c87497786be7d73f62fc6b3', 'request_id': 'req-d4cec706-dd17-4d52-aed0-bcc94029106c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:01.377816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ecd44c2c87497786be7d73f62fc6b3', 'request_id': 'req-d4cec706-dd17-4d52-aed0-bcc94029106c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:01.395970 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] The token cache is being invalidate because project 73ecd44c2c87497786be7d73f62fc6b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 13:58:01.396778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:01.398156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 13:58:01.400768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1205/2405] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 13:58:01 2022] DELETE /identity/v3/projects/73ecd44c2c87497786be7d73f62fc6b3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 13:58:06.853761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec046-d362-4f74-8f10-5d93ec79f145 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:06.854331 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec046-d362-4f74-8f10-5d93ec79f145 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:06.854458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec046-d362-4f74-8f10-5d93ec79f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:06.893213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-985ec046-d362-4f74-8f10-5d93ec79f145 None None] MFA Rules not processed for user `083b92ac8bf0405c80d53728c2d95a42`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:06.895585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-985ec046-d362-4f74-8f10-5d93ec79f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:06.898744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:06.971941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1201/2406] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:58:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:06.985760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:06.987235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:07.050228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec706-dd17-4d52-aed0-bcc94029106c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:07.054967 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:07.055634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:07.055922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:07.056349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:07.058536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:07.135427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:07.137013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:07.147802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1206/2407] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:07.466187 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:07.466483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:07.466805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:07.538932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:07.539172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:07.655271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1202/2408] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:58:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:58:07.888656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:07.890223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:07.971890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:08.000232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e08d3d-675c-4e20-a4b0-dff4198fa9f9 service glance] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:08.007916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:08.008618 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:08.008911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:08.009198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:08.019529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:08.023271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:08.036590 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1207/2409] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:58:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:58:11.591377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:11.592861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:11.652111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f6769-3cf2-4781-96eb-b50a8a4b80e7 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:11.655925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135656-dd85-426f-b005-4255f246d19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:11.656717 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135656-dd85-426f-b005-4255f246d19b service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:11.657078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135656-dd85-426f-b005-4255f246d19b service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:11.657417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135656-dd85-426f-b005-4255f246d19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:11.659467 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b6135656-dd85-426f-b005-4255f246d19b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:11.688725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:11.724160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6135656-dd85-426f-b005-4255f246d19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:11.725591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6135656-dd85-426f-b005-4255f246d19b service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:11.735069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1203/2410] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:15.071924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:15.086851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa948f4-9a69-42d4-8b91-070ad13f5e11 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:15.093503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:15.094729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:15.095239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:15.106751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:15.119571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:15.197236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:15.198701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:15.210759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1208/2411] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:17.851968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e24f-141c-48d9-9da8-bfcf9454fde0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:17.852586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e24f-141c-48d9-9da8-bfcf9454fde0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:17.852860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67e24f-141c-48d9-9da8-bfcf9454fde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:17.874397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3f67e24f-141c-48d9-9da8-bfcf9454fde0 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:17.875789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3f67e24f-141c-48d9-9da8-bfcf9454fde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:17.886894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1204/2412] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:58:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:17.907891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:17.923570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fc375-8cfd-411e-89dc-96d5b231693c service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:17.930326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31979-a2cd-45a0-8cd4-53f16d7db98b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:17.930993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31979-a2cd-45a0-8cd4-53f16d7db98b service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:17.931421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31979-a2cd-45a0-8cd4-53f16d7db98b service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:17.931710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31979-a2cd-45a0-8cd4-53f16d7db98b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:17.941672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31979-a2cd-45a0-8cd4-53f16d7db98b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:17.944525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31979-a2cd-45a0-8cd4-53f16d7db98b service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:17.954154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1209/2413] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:58:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:58:20.775664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cbd9a-2b61-4863-8922-e9849ff408b9 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:20.776747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cbd9a-2b61-4863-8922-e9849ff408b9 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:20.777149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cbd9a-2b61-4863-8922-e9849ff408b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:20.797153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-e19cbd9a-2b61-4863-8922-e9849ff408b9 None None] MFA Rules not processed for user `3c80d109325d4a4b9e9e97dfaccc5785`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:20.798374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e19cbd9a-2b61-4863-8922-e9849ff408b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:20.805940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1205/2414] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:58:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:25.492149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231d5a1-935c-4611-9a7c-71fb496c3436 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:25.493152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231d5a1-935c-4611-9a7c-71fb496c3436 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:25.493602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231d5a1-935c-4611-9a7c-71fb496c3436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:25.524042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9231d5a1-935c-4611-9a7c-71fb496c3436 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:25.525968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9231d5a1-935c-4611-9a7c-71fb496c3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:25.540703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1210/2415] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:58:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:25.552721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cbd9a-2b61-4863-8922-e9849ff408b9 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:25.567279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cbd9a-2b61-4863-8922-e9849ff408b9 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:25.578511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3903c5-cb76-467c-9e78-6079e8299330 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:25.581985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3903c5-cb76-467c-9e78-6079e8299330 service swift] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:25.582487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3903c5-cb76-467c-9e78-6079e8299330 service swift] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:25.582929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3903c5-cb76-467c-9e78-6079e8299330 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:25.593966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3903c5-cb76-467c-9e78-6079e8299330 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:25.596864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3903c5-cb76-467c-9e78-6079e8299330 service swift] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:25.606738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1206/2416] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:58:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:58:35.517419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=50 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:35.602819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=29 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:58:55.105031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac78c-7ae0-418e-8d4d-4632f9dd7b3a None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.106772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac78c-7ae0-418e-8d4d-4632f9dd7b3a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.107379 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ac78c-7ae0-418e-8d4d-4632f9dd7b3a None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.109152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1211/2417] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:58:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:58:55.117637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a0fa5-3201-4080-b204-6358e2eb48e4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.118209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a0fa5-3201-4080-b204-6358e2eb48e4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.118209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a0fa5-3201-4080-b204-6358e2eb48e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.137491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac78c-7ae0-418e-8d4d-4632f9dd7b3a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:55.149823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ac78c-7ae0-418e-8d4d-4632f9dd7b3a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:55.154917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699aab8-98b8-456d-8853-cb5e823c1117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:55.156139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699aab8-98b8-456d-8853-cb5e823c1117 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.156634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699aab8-98b8-456d-8853-cb5e823c1117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.157065 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699aab8-98b8-456d-8853-cb5e823c1117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.159212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6699aab8-98b8-456d-8853-cb5e823c1117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:55.160993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5e1a0fa5-3201-4080-b204-6358e2eb48e4 None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:55.162184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5e1a0fa5-3201-4080-b204-6358e2eb48e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:55.234030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1207/2418] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:58:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:55.242035 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699aab8-98b8-456d-8853-cb5e823c1117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:55.243491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699aab8-98b8-456d-8853-cb5e823c1117 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:55.245938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a0fa5-3201-4080-b204-6358e2eb48e4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:55.256530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1212/2419] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:55.257721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a0fa5-3201-4080-b204-6358e2eb48e4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:55.261417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d385d5-7d1d-4309-b202-19c64463e184 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:55.262684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d385d5-7d1d-4309-b202-19c64463e184 service glance] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.262973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d385d5-7d1d-4309-b202-19c64463e184 service glance] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.263383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d385d5-7d1d-4309-b202-19c64463e184 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.274413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d385d5-7d1d-4309-b202-19c64463e184 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:55.275900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d385d5-7d1d-4309-b202-19c64463e184 service glance] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:55.287414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1208/2420] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 13:58:55.508751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496133a-8399-4a8c-9a1c-e710e2a6f527 None None] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.509057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496133a-8399-4a8c-9a1c-e710e2a6f527 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.509346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496133a-8399-4a8c-9a1c-e710e2a6f527 None None] PATH_INFO: `/` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.510729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1213/2421] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:58:55.515647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14cae-6889-43aa-8ef1-2782e5945312 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.519382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14cae-6889-43aa-8ef1-2782e5945312 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.519382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed14cae-6889-43aa-8ef1-2782e5945312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.535236 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8ed14cae-6889-43aa-8ef1-2782e5945312 None None] MFA Rules not processed for user `d7b2b76c46b640c0b19b46ed50d333ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:55.536472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8ed14cae-6889-43aa-8ef1-2782e5945312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:55.544125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1209/2422] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:58:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:55.555409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496133a-8399-4a8c-9a1c-e710e2a6f527 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:55.557119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4496133a-8399-4a8c-9a1c-e710e2a6f527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:55.570417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496133a-8399-4a8c-9a1c-e710e2a6f527 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:55.573980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198aec12-faf1-464f-8f47-5fd5367d89c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:55.575122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aec12-faf1-464f-8f47-5fd5367d89c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.575415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aec12-faf1-464f-8f47-5fd5367d89c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.575692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198aec12-faf1-464f-8f47-5fd5367d89c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.582788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198aec12-faf1-464f-8f47-5fd5367d89c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:55.584202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198aec12-faf1-464f-8f47-5fd5367d89c4 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:55.592781 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1214/2423] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:55.674047 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728dda7-7df2-4030-b240-159c3a531d09 None None] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.674340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728dda7-7df2-4030-b240-159c3a531d09 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.674623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728dda7-7df2-4030-b240-159c3a531d09 None None] PATH_INFO: `/` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.675997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1210/2424] 10.222.0.33 () {54 vars in 921 bytes} [Thu Jun 2 13:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 02 13:58:55.680834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7a52-c287-4203-a034-0140513cfbaa None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.681129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7a52-c287-4203-a034-0140513cfbaa None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.681413 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac7a52-c287-4203-a034-0140513cfbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.700526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-4eac7a52-c287-4203-a034-0140513cfbaa None None] MFA Rules not processed for user `b73296e3c73644f29eb0b4960a747c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:58:55.701738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4eac7a52-c287-4203-a034-0140513cfbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:55.711153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1215/2425] 10.222.0.33 () {58 vars in 1018 bytes} [Thu Jun 2 13:58:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:58:55.722280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728dda7-7df2-4030-b240-159c3a531d09 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:55.735347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728dda7-7df2-4030-b240-159c3a531d09 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:55.738984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896516b-663d-400b-90a9-67737c0b98c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:55.739624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896516b-663d-400b-90a9-67737c0b98c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:55.739910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896516b-663d-400b-90a9-67737c0b98c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:55.740193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896516b-663d-400b-90a9-67737c0b98c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:55.751114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896516b-663d-400b-90a9-67737c0b98c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:55.752624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896516b-663d-400b-90a9-67737c0b98c0 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:55.763636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1211/2426] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:58:58.146275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7a52-c287-4203-a034-0140513cfbaa None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:58:58.155679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac7a52-c287-4203-a034-0140513cfbaa None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:58:58.159353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:58:58.159997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:58:58.160286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:58:58.160607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:58:58.162384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:58:58.175853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:58:58.177342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:58:58.188943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1216/2427] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:58:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:00.692925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:00.693395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:00.693487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:00.713039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:00.714319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:00.722318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1212/2428] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 13:59:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:00.734698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:00.745992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f1da2-012d-499a-91bf-b2fc55c5343f service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:00.752910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:00.753553 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:00.753855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:00.755802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:00.763452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:00.765096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:00.773230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1217/2429] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:59:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 02 13:59:02.147825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:02.149171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:02.164840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44779567-b8db-4862-8953-f5e11cbaab69 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:02.171388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:02.172051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:02.172372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:02.172693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:02.174498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:02.238153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:02.239830 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:02.250277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1213/2430] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:10.769926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=55 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:12.245054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=83 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:30.210865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:30.220261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f993df-a2e5-4ca1-8842-a0575ba6de45 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:30.223871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:30.224540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:30.224828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:30.225107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:30.234158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:30.236134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:30.245526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1218/2431] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:32.133172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:32.146602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa324e-9819-419f-a44e-af28e0beddaa service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:32.157189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:32.157857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:32.158148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:32.158432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:32.160240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:32.170283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:32.171692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:32.179901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1214/2432] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:32.447754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:32.461777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83134dae-a63f-40f6-8e50-12121be1a19b service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:32.467788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc2b9a-6bec-4a15-9621-fcf9cb5b18cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:32.468739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc2b9a-6bec-4a15-9621-fcf9cb5b18cc service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:32.469097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc2b9a-6bec-4a15-9621-fcf9cb5b18cc service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:32.469444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc2b9a-6bec-4a15-9621-fcf9cb5b18cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:32.471380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4bbc2b9a-6bec-4a15-9621-fcf9cb5b18cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:32.490697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc2b9a-6bec-4a15-9621-fcf9cb5b18cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:32.492300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc2b9a-6bec-4a15-9621-fcf9cb5b18cc service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:32.506276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1219/2433] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:33.098403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:33.115314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377864e3-abd5-433c-9c51-9ffdf545a06a service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:33.121179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:33.121864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:33.122155 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:33.122438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:33.124888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:33.197099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:33.199624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:33.210822 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1215/2434] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 13:59:37.312823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda8fe-64d8-435f-abab-ff2925f02215 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:37.313830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda8fe-64d8-435f-abab-ff2925f02215 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:37.313961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdda8fe-64d8-435f-abab-ff2925f02215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:37.333284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-8bdda8fe-64d8-435f-abab-ff2925f02215 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:37.334502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8bdda8fe-64d8-435f-abab-ff2925f02215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:37.341731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1220/2435] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 2 13:59:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 13:59:37.363369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:37.374558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab54913-d180-4f0d-8883-724131a8fe91 service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:37.380542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:37.381188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:37.381468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:37.381753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:37.391895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:37.393624 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:37.402900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1216/2436] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 13:59:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 13:59:47.327110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=15 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:47.399433 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=40 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 13:59:56.176367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea15f0-32ca-4773-9034-a1681cf858eb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:56.183405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea15f0-32ca-4773-9034-a1681cf858eb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:56.183405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ea15f0-32ca-4773-9034-a1681cf858eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:56.197147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-c6ea15f0-32ca-4773-9034-a1681cf858eb None None] MFA Rules not processed for user `b8d05eeb8ac146969b99d33084f1664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 13:59:56.198367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c6ea15f0-32ca-4773-9034-a1681cf858eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:56.255575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1221/2437] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 13:59:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 13:59:57.036934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 13:59:57.038987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:57.119669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed85ad7-7c2a-4a48-bbb1-12de58b9bae4 service swift] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 13:59:57.124774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 13:59:57.125427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 13:59:57.125715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 13:59:57.125997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 13:59:57.127783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 13:59:57.140396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 13:59:57.142030 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 13:59:57.152570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1217/2438] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 13:59:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:00:01.590636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea15f0-32ca-4773-9034-a1681cf858eb None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:01.605235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ea15f0-32ca-4773-9034-a1681cf858eb None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:01.611218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64484c4-67df-4bf4-a40d-219e1afb2b87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:01.611889 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64484c4-67df-4bf4-a40d-219e1afb2b87 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:01.612243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64484c4-67df-4bf4-a40d-219e1afb2b87 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:01.612569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64484c4-67df-4bf4-a40d-219e1afb2b87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:01.615308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a64484c4-67df-4bf4-a40d-219e1afb2b87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:01.637616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64484c4-67df-4bf4-a40d-219e1afb2b87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:01.639783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64484c4-67df-4bf4-a40d-219e1afb2b87 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:01.653188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1222/2439] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:00:07.148261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=32 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:10.712239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:00:10.714459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:10.730685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feae6f0f-0ba4-4495-bb4c-fc033da2fd88 service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:00:10.737090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:00:10.737090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:10.737326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:10.737556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:10.739329 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:10.752285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:00:10.753898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:00:10.764382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1218/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:00:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:00:11.647427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=31 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:12.777540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cf52e-6c05-4ff8-a3c2-fc63bd750e14 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:00:12.778271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cf52e-6c05-4ff8-a3c2-fc63bd750e14 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:00:12.778271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893cf52e-6c05-4ff8-a3c2-fc63bd750e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:00:12.799626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-893cf52e-6c05-4ff8-a3c2-fc63bd750e14 None None] MFA Rules not processed for user `f9e57606c14a4ad99612414c1f9719f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:00:12.801262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-893cf52e-6c05-4ff8-a3c2-fc63bd750e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:00:12.809783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1223/2441] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:00:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:00:20.759936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=6 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:00:22.791769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:25.627126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:25.628707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:25.694017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64c44a-7b10-4dab-bf17-d00e3432949b service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:25.698328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823c09f-2505-4261-973b-3a323f0f7510 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:25.699082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c09f-2505-4261-973b-3a323f0f7510 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:25.699597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c09f-2505-4261-973b-3a323f0f7510 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:25.700279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823c09f-2505-4261-973b-3a323f0f7510 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:25.701957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0823c09f-2505-4261-973b-3a323f0f7510 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:25.771286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823c09f-2505-4261-973b-3a323f0f7510 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:25.772936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823c09f-2505-4261-973b-3a323f0f7510 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:25.784589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1219/2442] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:01:25.974525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cf52e-6c05-4ff8-a3c2-fc63bd750e14 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:25.989321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893cf52e-6c05-4ff8-a3c2-fc63bd750e14 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:25.995659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:25.996456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:25.996940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:25.997635 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:26.000767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:26.099061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:26.101069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:26.112740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1224/2443] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:01:29.863541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d99495-db25-4b4a-9b02-47a9bd66e2e2 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:29.863541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d99495-db25-4b4a-9b02-47a9bd66e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:29.863541 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d99495-db25-4b4a-9b02-47a9bd66e2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:29.881217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-95d99495-db25-4b4a-9b02-47a9bd66e2e2 None None] MFA Rules not processed for user `315c0d9d9a284389ae07bf898c330605`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:01:29.882443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-95d99495-db25-4b4a-9b02-47a9bd66e2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:29.890536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1220/2444] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:01:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:01:30.240105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:30.250484 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f84a5-5590-4fca-9de3-dc3659e9a137 service nova] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:30.254420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:30.255101 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:30.255390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:30.255671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:30.258275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:30.271344 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:30.273180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:30.285585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1225/2445] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:01:36.303512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35383864-fb79-4f9b-bbdf-7a06b1323a9e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:36.303992 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35383864-fb79-4f9b-bbdf-7a06b1323a9e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:36.304091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35383864-fb79-4f9b-bbdf-7a06b1323a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:36.323371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-35383864-fb79-4f9b-bbdf-7a06b1323a9e None None] MFA Rules not processed for user `4dd10f5fa400450fb64360391a871bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:01:36.324675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-35383864-fb79-4f9b-bbdf-7a06b1323a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:36.331869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1221/2446] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:01:40.279012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=34 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:41.841941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:01:41.850525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88630667-dbcf-49f5-af7a-e4bf9e698373 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:01:41.854306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:01:41.854946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:01:41.855238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:01:41.855518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:01:41.857333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:01:41.867122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:01:41.868581 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:01:41.877921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1226/2447] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:01:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:01:46.317932 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=54 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:01:51.873170 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:01.202127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35383864-fb79-4f9b-bbdf-7a06b1323a9e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:01.214196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35383864-fb79-4f9b-bbdf-7a06b1323a9e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:01.219896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:01.220617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:01.220910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:01.221192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:01.223017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:01.235188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:01.237200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:01.249865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1222/2448] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:11.245336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=6 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:16.426861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:16.439755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54dba-ee0f-46e9-902a-3602a735dd4d service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:16.445446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:16.446094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:16.446389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:16.446673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:16.448934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:16.459754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:16.461378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:16.470433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1227/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:20.429095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:20.439112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd53c7-9ab8-43c3-a8a8-19d3161a7ebf service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:20.443561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:20.444367 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:20.444874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:20.445340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:20.447307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:20.515997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:20.517519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:20.529073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1223/2450] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:24.605643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:24.605643 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:24.606222 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf695-6693-4888-aa91-7818c7994283 service nova] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:24.612326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:24.613111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:24.613346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:24.613626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:24.615466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:24.629303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:24.631406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:24.643861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1228/2451] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:24.729727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:24.731396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:24.744479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7a381-ca11-4608-8a7c-e4d652eeff3a service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:24.749265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:24.750140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:24.750431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:24.750771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] PATH_INFO: `/v3/users/f9e57606c14a4ad99612414c1f9719f4` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:24.751995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e57606c14a4ad99612414c1f9719f4)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:24.754873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:24.955674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e57606c14a4ad99612414c1f9719f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.037893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e57606c14a4ad99612414c1f9719f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.051843 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e57606c14a4ad99612414c1f9719f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.059909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e57606c14a4ad99612414c1f9719f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.060613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-8b2e31fa-f01c-420c-8ff2-0096fdbd0069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e57606c14a4ad99612414c1f9719f4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.067258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1224/2452] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:02:24 2022] DELETE /identity/v3/users/f9e57606c14a4ad99612414c1f9719f4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:02:25.311322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:25.322210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702de9d-0810-4255-80fa-4022f5f87dd1 service placement] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:25.396152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:25.397063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:25.397347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:25.397626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] PATH_INFO: `/v3/projects/b067e3c448e24f179830992fecf65399` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:25.398818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b067e3c448e24f179830992fecf65399)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:25.400748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:25.510841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b067e3c448e24f179830992fecf65399', 'request_id': 'req-61332d18-47f5-4321-b0d6-b47242367a81'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.517138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b067e3c448e24f179830992fecf65399', 'request_id': 'req-61332d18-47f5-4321-b0d6-b47242367a81'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.583368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b067e3c448e24f179830992fecf65399', 'request_id': 'req-61332d18-47f5-4321-b0d6-b47242367a81'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.594356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] The token cache is being invalidate because project b067e3c448e24f179830992fecf65399 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:02:25.594653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.595315 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-61332d18-47f5-4321-b0d6-b47242367a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:02:25.597916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1229/2453] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:02:25 2022] DELETE /identity/v3/projects/b067e3c448e24f179830992fecf65399 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:02:25.602712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea85cf-444b-4c09-bd14-0fdf2fd21935 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:25.603010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea85cf-444b-4c09-bd14-0fdf2fd21935 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:25.603298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea85cf-444b-4c09-bd14-0fdf2fd21935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:25.620970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0eea85cf-444b-4c09-bd14-0fdf2fd21935 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:25.622184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0eea85cf-444b-4c09-bd14-0fdf2fd21935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:25.681662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1225/2454] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:25.689409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685faac-b431-46e8-bd50-c2a09877ed76 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:25.690021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685faac-b431-46e8-bd50-c2a09877ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:25.690150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685faac-b431-46e8-bd50-c2a09877ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:25.709917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1685faac-b431-46e8-bd50-c2a09877ed76 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:25.711140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1685faac-b431-46e8-bd50-c2a09877ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:25.719488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1230/2455] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:25.724355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea85cf-444b-4c09-bd14-0fdf2fd21935 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:25.734055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea85cf-444b-4c09-bd14-0fdf2fd21935 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:25.738970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:25.739752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:25.740034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:25.740313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:25.741069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:02:25.741374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:25.743040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:25.749893 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:25.756252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1226/2456] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:02:25.760721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685faac-b431-46e8-bd50-c2a09877ed76 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:25.770492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685faac-b431-46e8-bd50-c2a09877ed76 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:25.775251 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:25.775904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:25.776194 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:25.776516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:25.777200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:25.779102 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:25.884096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1231/2457] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:02:25 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:02:25.887792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:25.898449 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d822b4-9c55-4adf-8e3b-825eb6e76835 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:25.954280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:25.954949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:25.955235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:25.955514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:25.956225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:25.958858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:26.064382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1227/2458] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:02:25 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:02:26.069069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:26.079807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302df6a0-dcc7-48e6-b8cb-d2e2455b02df admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:26.085576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:26.086239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:26.086525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:26.086803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:26.087554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:26.089235 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:26.099430 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1232/2459] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:02:26.103455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:26.113560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638458de-6eb1-49fe-bb0d-f77ccab3b053 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:26.118322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef508e56-7d60-4e49-adc5-c370c167e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:26.119212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508e56-7d60-4e49-adc5-c370c167e311 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:26.119318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508e56-7d60-4e49-adc5-c370c167e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:26.119601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef508e56-7d60-4e49-adc5-c370c167e311 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:26.120334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef508e56-7d60-4e49-adc5-c370c167e311 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:26.122025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef508e56-7d60-4e49-adc5-c370c167e311 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:26.133570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1228/2460] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:02:26.137802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:26.148924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54744-dd69-4aca-97b3-7dd22ccf27b7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:26.153530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:26.154411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:26.154700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:26.154980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] PATH_INFO: `/v3/projects/fbb232ab0a2347dea2fa82e1cdbf24b5/users/36e78feea3104797a5e927c8ffb76d18/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:26.167779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:26.170995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb232ab0a2347dea2fa82e1cdbf24b5, user_id=36e78feea3104797a5e927c8ffb76d18, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:26.173709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:26.275282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1233/2461] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:02:26 2022] PUT /identity/v3/projects/fbb232ab0a2347dea2fa82e1cdbf24b5/users/36e78feea3104797a5e927c8ffb76d18/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:02:26.280381 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78b88-d490-44f8-bb51-2b4ef74cbb36 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:26.285914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78b88-d490-44f8-bb51-2b4ef74cbb36 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:26.285914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf78b88-d490-44f8-bb51-2b4ef74cbb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:26.298951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-bdf78b88-d490-44f8-bb51-2b4ef74cbb36 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:26.300946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bdf78b88-d490-44f8-bb51-2b4ef74cbb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:26.358564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1229/2462] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:26.370096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:26.371845 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:26.430594 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ac5ef-23e9-430b-ae5f-59248a55136b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:26.434610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:26.435290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:26.435578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:26.435856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:26.445471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:26.447071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:26.458943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1234/2463] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:32.350884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9b84a-7d18-49bf-9880-868744ce5714 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:32.351355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9b84a-7d18-49bf-9880-868744ce5714 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:32.351355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9b84a-7d18-49bf-9880-868744ce5714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:32.436638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b5a9b84a-7d18-49bf-9880-868744ce5714 None None] MFA Rules not processed for user `36e78feea3104797a5e927c8ffb76d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:32.437891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b5a9b84a-7d18-49bf-9880-868744ce5714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:32.536222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1230/2464] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:32.550095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:02:32.552363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:32.647787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2d5b3-51a9-4a3a-9da9-b2f37db228ff service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:02:32.654181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca4433-6379-4e46-83fa-de6b4d375eda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:02:32.654850 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca4433-6379-4e46-83fa-de6b4d375eda service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:32.655142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca4433-6379-4e46-83fa-de6b4d375eda service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:32.655424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca4433-6379-4e46-83fa-de6b4d375eda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:32.665373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca4433-6379-4e46-83fa-de6b4d375eda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:02:32.667938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca4433-6379-4e46-83fa-de6b4d375eda service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:02:32.679175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1235/2465] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:02:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:02:36.142827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d4bc2-5d99-404a-9b0f-d5305a700146 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:36.143375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d4bc2-5d99-404a-9b0f-d5305a700146 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:36.143375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d4bc2-5d99-404a-9b0f-d5305a700146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:36.150900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:36.168790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-338d4bc2-5d99-404a-9b0f-d5305a700146 None None] MFA Rules not processed for user `36e78feea3104797a5e927c8ffb76d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:36.170059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-338d4bc2-5d99-404a-9b0f-d5305a700146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:36.178789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1231/2466] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:36.474989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea63ce-6448-49c0-afa5-d941e360a552 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:02:36.475574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea63ce-6448-49c0-afa5-d941e360a552 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:02:36.475770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea63ce-6448-49c0-afa5-d941e360a552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:02:36.507187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-81ea63ce-6448-49c0-afa5-d941e360a552 None None] MFA Rules not processed for user `b8d05eeb8ac146969b99d33084f1664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:02:36.508598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-81ea63ce-6448-49c0-afa5-d941e360a552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:02:36.574584 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1236/2467] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:02:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:02:46.346961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:02:46.566630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:06.446701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d4bc2-5d99-404a-9b0f-d5305a700146 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:06.463912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d4bc2-5d99-404a-9b0f-d5305a700146 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:06.472325 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:06.473027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:06.473315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:06.473656 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:06.476046 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:06.541583 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:06.543211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:06.552179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1232/2468] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:07.810621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a58f9-cc9f-4aa7-a56d-df3015cabb03 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:07.811082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a58f9-cc9f-4aa7-a56d-df3015cabb03 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:07.811395 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a58f9-cc9f-4aa7-a56d-df3015cabb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:07.830883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bd9a58f9-cc9f-4aa7-a56d-df3015cabb03 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:03:07.837246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bd9a58f9-cc9f-4aa7-a56d-df3015cabb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:07.888060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1237/2469] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 2 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:03:08.056185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:08.057654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:08.130083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25f2d3-f8c0-47ee-a6b8-bed5456b775b service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:08.135728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:08.136377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:08.136695 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:08.136972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:08.145509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:08.147713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:08.156086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1233/2470] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 14:03:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:03:09.272469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a58f9-cc9f-4aa7-a56d-df3015cabb03 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:09.281664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a58f9-cc9f-4aa7-a56d-df3015cabb03 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:09.285339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:09.285979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:09.286268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:09.286547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:09.289038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:09.300515 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:09.301931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:09.312086 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1238/2471] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:12.982904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:12.985924 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:13.061463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd801a6-5936-4c7d-9c05-925f680bb178 service swift] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:13.066516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:13.067161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:13.069203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:13.069203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:13.069578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:13.081573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:13.083172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:13.093184 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1234/2472] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:03:16.923500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:16.925345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:16.939717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76609-bc64-45aa-b8ca-011107b777ff service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:16.945711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:16.947465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:16.947939 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:16.948527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] PATH_INFO: `/v3/users/3c80d109325d4a4b9e9e97dfaccc5785` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:16.950780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c80d109325d4a4b9e9e97dfaccc5785)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:16.954975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:17.157824 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c80d109325d4a4b9e9e97dfaccc5785'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.228092 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c80d109325d4a4b9e9e97dfaccc5785'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.241532 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c80d109325d4a4b9e9e97dfaccc5785'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.248304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c80d109325d4a4b9e9e97dfaccc5785'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.248983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c80d109325d4a4b9e9e97dfaccc5785'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.255527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1239/2473] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:03:16 2022] DELETE /identity/v3/users/3c80d109325d4a4b9e9e97dfaccc5785 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:03:17.542163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:17.554671 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef4afb-bf33-4e87-8f65-a3560829c795 service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:17.571989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=100 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:17.618984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:17.619837 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:17.620119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:17.620396 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] PATH_INFO: `/v3/projects/93c4473545ff46bbaa857263e85af2f1` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:17.621616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93c4473545ff46bbaa857263e85af2f1)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:17.623516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:17.723864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93c4473545ff46bbaa857263e85af2f1', 'request_id': 'req-287de326-5999-49bf-a7e1-e0f68cbdc012'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.730914 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93c4473545ff46bbaa857263e85af2f1', 'request_id': 'req-287de326-5999-49bf-a7e1-e0f68cbdc012'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.776790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93c4473545ff46bbaa857263e85af2f1', 'request_id': 'req-287de326-5999-49bf-a7e1-e0f68cbdc012'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.787922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] The token cache is being invalidate because project 93c4473545ff46bbaa857263e85af2f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:03:17.788211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.788896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:17.790445 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1235/2474] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:03:17 2022] DELETE /identity/v3/projects/93c4473545ff46bbaa857263e85af2f1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:03:17.794471 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:17.795896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:17.809782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f640bb-ec90-4ead-80c0-f6b370af263d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:17.868725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:17.869604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:17.869888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:17.870166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] PATH_INFO: `/v3/users/083b92ac8bf0405c80d53728c2d95a42` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:17.871350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083b92ac8bf0405c80d53728c2d95a42)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:17.873527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:17.878302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:18.070297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083b92ac8bf0405c80d53728c2d95a42'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.136754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083b92ac8bf0405c80d53728c2d95a42'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.150303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083b92ac8bf0405c80d53728c2d95a42'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.157146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083b92ac8bf0405c80d53728c2d95a42'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.157830 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083b92ac8bf0405c80d53728c2d95a42'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.164679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1240/2475] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:03:17 2022] DELETE /identity/v3/users/083b92ac8bf0405c80d53728c2d95a42 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:03:18.421431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:18.422900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:18.437827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287de326-5999-49bf-a7e1-e0f68cbdc012 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:18.497135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:18.497997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:18.498279 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:18.498552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] PATH_INFO: `/v3/projects/7cce971099ae45d3b7ea8a76dc90472e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:18.499846 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cce971099ae45d3b7ea8a76dc90472e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:18.501963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:18.765309 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cce971099ae45d3b7ea8a76dc90472e', 'request_id': 'req-5dc74daf-eb03-431f-8c63-d0830b87d763'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.766436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:18.772201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cce971099ae45d3b7ea8a76dc90472e', 'request_id': 'req-5dc74daf-eb03-431f-8c63-d0830b87d763'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.854189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cce971099ae45d3b7ea8a76dc90472e', 'request_id': 'req-5dc74daf-eb03-431f-8c63-d0830b87d763'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.865212 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] The token cache is being invalidate because project 7cce971099ae45d3b7ea8a76dc90472e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:03:18.866311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.867611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:03:18.871967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1236/2476] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:03:18 2022] DELETE /identity/v3/projects/7cce971099ae45d3b7ea8a76dc90472e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:03:28.160152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=24,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:28.934407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=6,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:03:59.584361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:03:59.585901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:59.643339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b111fe-1e3b-4f38-9de4-38becbcf04b0 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:03:59.689975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:03:59.690616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:03:59.690904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:03:59.691185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:03:59.693006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:03:59.762260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:03:59.764191 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:03:59.775805 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1241/2477] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:03:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:00.169395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:00.170955 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:00.228360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc74daf-eb03-431f-8c63-d0830b87d763 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:00.233593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:00.234241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:00.234528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:00.234816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:00.236672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:00.251226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:00.253706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:00.264869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1237/2478] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:02.572842 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:02.574370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:02.590342 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7dfb8-0ba0-4547-885c-11702bcb0d16 service glance] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:02.596712 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:02.597384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:02.597925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:02.598211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:02.600388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:02.675297 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:02.704550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:02.706228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:02.736267 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1242/2479] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:07.918731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:07.920859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:07.933109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e6946-b92b-4839-a25c-ddb9004b9b08 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:07.937451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:07.938097 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:07.938384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:07.938665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:07.940480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:08.003552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:08.005052 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:08.014767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1238/2480] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:04:12.744782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=15 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:15.391506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:15.393036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:15.407415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0f9dc-03db-462a-9ac3-41a797e65be8 service nova] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:15.411905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:15.412871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:15.413156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:15.413440 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] PATH_INFO: `/v3/users/198160f6a7524bbb9f90798d2269db00` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:15.414610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=198160f6a7524bbb9f90798d2269db00)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:15.416545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:15.657500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '198160f6a7524bbb9f90798d2269db00'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:15.735762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '198160f6a7524bbb9f90798d2269db00'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:15.749195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '198160f6a7524bbb9f90798d2269db00'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:15.756046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '198160f6a7524bbb9f90798d2269db00'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:15.756747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '198160f6a7524bbb9f90798d2269db00'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:15.763652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1243/2481] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:04:15 2022] DELETE /identity/v3/users/198160f6a7524bbb9f90798d2269db00 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:04:16.054933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:16.065732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136ef55-feaf-4c78-9a70-a1f2b4f90a80 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:16.131310 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:16.132217 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:16.132572 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:16.132847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] PATH_INFO: `/v3/projects/c5c02b70c6fa4d4b999cca3d9f6154c5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:16.134079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c02b70c6fa4d4b999cca3d9f6154c5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:16.136074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:16.284425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:16.291113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'request_id': 'req-4a6858b0-5d34-48b9-a6c4-e9249657b738'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.298051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'request_id': 'req-4a6858b0-5d34-48b9-a6c4-e9249657b738'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.378799 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c02b70c6fa4d4b999cca3d9f6154c5', 'request_id': 'req-4a6858b0-5d34-48b9-a6c4-e9249657b738'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.390870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] The token cache is being invalidate because project c5c02b70c6fa4d4b999cca3d9f6154c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:04:16.391160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.391795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.393392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1239/2482] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:04:16 2022] DELETE /identity/v3/projects/c5c02b70c6fa4d4b999cca3d9f6154c5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:04:16.397535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:16.398942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:16.412812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694cf65c-406f-41b7-a7f9-3467b3c81ad2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:16.471150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:16.472029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:16.472321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:16.472641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] PATH_INFO: `/v3/users/151a5bcf77bb442883631963a47cfb15` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:16.473901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=151a5bcf77bb442883631963a47cfb15)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:16.475857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:16.652216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '151a5bcf77bb442883631963a47cfb15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.735675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '151a5bcf77bb442883631963a47cfb15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.747865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '151a5bcf77bb442883631963a47cfb15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.749919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:16.754949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '151a5bcf77bb442883631963a47cfb15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.755586 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96f3d0a9-1032-43df-81bb-6a87a1aaf9c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '151a5bcf77bb442883631963a47cfb15'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:16.761499 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1244/2483] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:04:16 2022] DELETE /identity/v3/users/151a5bcf77bb442883631963a47cfb15 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:04:17.037980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:17.039418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:17.052558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6858b0-5d34-48b9-a6c4-e9249657b738 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:17.116472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:17.116472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:17.116472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:17.116472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] PATH_INFO: `/v3/projects/37641ac36b3e453db0cedf861cc761b8` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:17.117417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=37641ac36b3e453db0cedf861cc761b8)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:17.118985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:17.277390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37641ac36b3e453db0cedf861cc761b8', 'request_id': 'req-a265f1ee-ac22-4ad3-a946-84c792465b6c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:17.284172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37641ac36b3e453db0cedf861cc761b8', 'request_id': 'req-a265f1ee-ac22-4ad3-a946-84c792465b6c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:17.384348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37641ac36b3e453db0cedf861cc761b8', 'request_id': 'req-a265f1ee-ac22-4ad3-a946-84c792465b6c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:17.396027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] The token cache is being invalidate because project 37641ac36b3e453db0cedf861cc761b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:04:17.396314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:17.396967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:04:17.398500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1240/2484] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:04:17 2022] DELETE /identity/v3/projects/37641ac36b3e453db0cedf861cc761b8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:04:26.870144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:27.393081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:28.743993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70c6de-bef7-4462-be8b-5392bd5b8e45 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:28.744522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70c6de-bef7-4462-be8b-5392bd5b8e45 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:28.744631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70c6de-bef7-4462-be8b-5392bd5b8e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:28.762596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bf70c6de-bef7-4462-be8b-5392bd5b8e45 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:04:28.763802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bf70c6de-bef7-4462-be8b-5392bd5b8e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:28.826822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1245/2485] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 14:04:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:04:28.960532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:28.961954 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:29.040271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a265f1ee-ac22-4ad3-a946-84c792465b6c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:29.045417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:29.047368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:29.047368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:29.047368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:29.056042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:29.057673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:29.066385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1241/2486] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 14:04:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:04:36.247239 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:36.247875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:36.247875 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:36.268096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] MFA Rules not processed for user `315c0d9d9a284389ae07bf898c330605`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:04:36.269422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:36.329253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1246/2487] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:04:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:04:39.062940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=32 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:41.291752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:41.293227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:41.368079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b9e5b-b06e-48bb-b94a-4964aa22a4bb service swift] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:41.372707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:41.373458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:41.373807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:41.374160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:41.376577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:41.400395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:41.403358 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:41.415332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1242/2488] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:04:46.321659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=50 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:51.410800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=26 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:04:52.161754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:52.163207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:52.220776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276c9ac-31c5-417e-ab92-6ef64b0b1cf9 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:52.224946 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:52.225582 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:52.225865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:52.226143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:52.227901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:52.296945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:52.298318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:52.309567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1247/2489] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:04:52.562689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:52.571933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21c1e80-d56f-4f25-9b7e-a82ec4ac0b56 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:52.575834 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570c37f-21f4-47ef-853e-a81d66dabbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:52.576526 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c37f-21f4-47ef-853e-a81d66dabbee service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:52.576819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c37f-21f4-47ef-853e-a81d66dabbee service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:52.577120 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570c37f-21f4-47ef-853e-a81d66dabbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:52.578989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e570c37f-21f4-47ef-853e-a81d66dabbee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:52.593528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c37f-21f4-47ef-853e-a81d66dabbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:52.599693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570c37f-21f4-47ef-853e-a81d66dabbee service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:52.609928 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1243/2490] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:52.689351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:52.699410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350a105-c0af-420f-8b42-7e1b8518451c service glance] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:52.703341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:52.703993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:52.704647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:52.704780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:52.706572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:52.721738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:52.723874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:52.735443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1248/2491] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:04:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:04:55.297140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:55.297632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:55.297758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:55.315390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:04:55.316611 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:04:55.323927 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1244/2492] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 14:04:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:04:55.335770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:04:55.346892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930543-5142-4b9e-8eef-65bbb77e2abb service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:04:55.352694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:04:55.366116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:04:55.366116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:04:55.366116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:04:55.366116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:04:55.366116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:04:55.372120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1249/2493] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 14:04:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:05:05.310563 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=9 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:05.368843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=66 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:21.121984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:21.121984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:21.197425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632e52a-3794-40c0-9de1-bd5c387ff32f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:21.203086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371dbed-fdfb-47a6-b78f-6f816d464d54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:21.203674 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371dbed-fdfb-47a6-b78f-6f816d464d54 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:21.203963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371dbed-fdfb-47a6-b78f-6f816d464d54 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:21.204246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371dbed-fdfb-47a6-b78f-6f816d464d54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:21.206206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2371dbed-fdfb-47a6-b78f-6f816d464d54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:21.219399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371dbed-fdfb-47a6-b78f-6f816d464d54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:21.221083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371dbed-fdfb-47a6-b78f-6f816d464d54 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:21.233247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1245/2494] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:05:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:05:21.910556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:21.912071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:21.955254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037f3c8-5982-4fa6-90f5-0df77b412408 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:21.959552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:21.960182 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:21.960495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:21.960774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:21.962567 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:22.023263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:22.024644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:22.034062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1250/2495] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:05:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:05:23.518411 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b773d10-e914-4b30-9af8-2738cb4e5b42 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:23.518942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b773d10-e914-4b30-9af8-2738cb4e5b42 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:23.519039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b773d10-e914-4b30-9af8-2738cb4e5b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:23.537942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8b773d10-e914-4b30-9af8-2738cb4e5b42 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:05:23.539210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8b773d10-e914-4b30-9af8-2738cb4e5b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:23.546609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1246/2496] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 2 14:05:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:05:23.561908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:23.574152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da3239-fab8-471f-b06c-dc2a780a19d3 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:23.579237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:23.579936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:23.580234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:23.580551 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:23.590205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:23.591856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:23.601138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1251/2497] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 14:05:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:05:24.432326 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b773d10-e914-4b30-9af8-2738cb4e5b42 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:24.445606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b773d10-e914-4b30-9af8-2738cb4e5b42 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:24.451343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f5c25-b816-4b4a-b1f9-7f400f2a1cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:24.452057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f5c25-b816-4b4a-b1f9-7f400f2a1cd9 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:24.452349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f5c25-b816-4b4a-b1f9-7f400f2a1cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:24.452670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f5c25-b816-4b4a-b1f9-7f400f2a1cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:24.454535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a94f5c25-b816-4b4a-b1f9-7f400f2a1cd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:24.468036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f5c25-b816-4b4a-b1f9-7f400f2a1cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:24.469685 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f5c25-b816-4b4a-b1f9-7f400f2a1cd9 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:24.483663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1247/2498] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:05:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:05:33.597343 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=50 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:34.477474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=37 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:42.520820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:42.522397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:42.539407 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccff778-1129-47da-91d3-2bef3a83c135 service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:42.549687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:42.549687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:42.549687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:42.549687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:42.550181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:42.561305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:42.562906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:42.577389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1252/2499] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:05:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:05:48.241158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b427a-9cd0-4076-a526-f6023277014a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:48.241694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b427a-9cd0-4076-a526-f6023277014a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:48.242083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b427a-9cd0-4076-a526-f6023277014a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:48.259328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-2b6b427a-9cd0-4076-a526-f6023277014a None None] MFA Rules not processed for user `b8d05eeb8ac146969b99d33084f1664c`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:05:48.260577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2b6b427a-9cd0-4076-a526-f6023277014a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:48.313770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1248/2500] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:05:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:05:49.066014 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:05:49.067479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:49.141263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4931439d-167d-4e5f-90d9-be42c60d4f62 service nova] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:05:49.146435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:05:49.147081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:05:49.147412 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:05:49.148190 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:05:49.150038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:05:49.161380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:05:49.162950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:05:49.173688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1253/2501] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:05:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:05:58.307233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=25 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:05:59.169213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=38 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:52.127934 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b427a-9cd0-4076-a526-f6023277014a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:52.137553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b427a-9cd0-4076-a526-f6023277014a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:52.141282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:52.141922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:52.142207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:52.142485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:52.144265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:52.234095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:52.236104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:52.255595 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1249/2502] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:06:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:06:55.832226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:55.834227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:55.849405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41152-8b9a-4188-be6e-2cd5f0b116c3 service placement] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:55.854107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:55.865503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:55.865503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:55.865503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] PATH_INFO: `/v3/users/4dd10f5fa400450fb64360391a871bb8` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:55.865503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd10f5fa400450fb64360391a871bb8)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:55.865503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:56.025501 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd10f5fa400450fb64360391a871bb8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.100513 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd10f5fa400450fb64360391a871bb8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.113437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd10f5fa400450fb64360391a871bb8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.120209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd10f5fa400450fb64360391a871bb8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.120905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-ce76cb63-248a-4293-9413-aabfe96ffcd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd10f5fa400450fb64360391a871bb8'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.127545 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1254/2503] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:06:55 2022] DELETE /identity/v3/users/4dd10f5fa400450fb64360391a871bb8 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:06:56.365668 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:56.376308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba2550-b195-4083-94fd-9f99d21a115f service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:56.434581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:56.435437 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:56.435719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:56.435995 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] PATH_INFO: `/v3/projects/56c3f04e3f164a77b32b1e320d979863` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:56.437275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56c3f04e3f164a77b32b1e320d979863)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:56.439249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:56.544364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56c3f04e3f164a77b32b1e320d979863', 'request_id': 'req-6adcd0e5-490b-45a5-9a56-651be490c521'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.551085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56c3f04e3f164a77b32b1e320d979863', 'request_id': 'req-6adcd0e5-490b-45a5-9a56-651be490c521'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.618009 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56c3f04e3f164a77b32b1e320d979863', 'request_id': 'req-6adcd0e5-490b-45a5-9a56-651be490c521'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.622867 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:56.628996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] The token cache is being invalidate because project 56c3f04e3f164a77b32b1e320d979863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:06:56.629283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.629898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6adcd0e5-490b-45a5-9a56-651be490c521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:06:56.631453 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1250/2504] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:06:56 2022] DELETE /identity/v3/projects/56c3f04e3f164a77b32b1e320d979863 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:06:56.636487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2ca9-743e-4862-97e7-5d5330fbab55 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:56.636789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2ca9-743e-4862-97e7-5d5330fbab55 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:56.637074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e2ca9-743e-4862-97e7-5d5330fbab55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:56.693397 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bc8e2ca9-743e-4862-97e7-5d5330fbab55 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:56.694870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bc8e2ca9-743e-4862-97e7-5d5330fbab55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:56.754569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1255/2505] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:56.762213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0f8b-6066-4bb7-903a-56bb4b87f262 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:56.762511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0f8b-6066-4bb7-903a-56bb4b87f262 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:56.762796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b0f8b-6066-4bb7-903a-56bb4b87f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:56.781952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-fd1b0f8b-6066-4bb7-903a-56bb4b87f262 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:56.783158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-fd1b0f8b-6066-4bb7-903a-56bb4b87f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:56.791465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1251/2506] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:56.795881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2ca9-743e-4862-97e7-5d5330fbab55 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:56.806512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e2ca9-743e-4862-97e7-5d5330fbab55 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:56.811287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:56.811943 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:56.812238 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:56.812703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:56.813672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:06:56.813984 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:56.815651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:56.829368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1256/2507] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:06:56.833653 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b0f8b-6066-4bb7-903a-56bb4b87f262 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:56.842984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b0f8b-6066-4bb7-903a-56bb4b87f262 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:56.848438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:56.849086 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:56.849372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:56.849682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:56.850375 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:56.852289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:56.948377 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1252/2508] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:06:56 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:06:56.952601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:56.963426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffe239-7451-4ff0-b888-e4b591d39c57 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:56.989302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:57.020891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.024435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.024435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.024435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.024435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.025494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.126944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1257/2509] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:06:56 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:06:57.131210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.143360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac62a60-ae8b-4b5e-bbcc-6e28ec309bf0 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.148335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.149029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.149318 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.149598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.150345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.152194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.165732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1253/2510] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:06:57.169732 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.180495 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3904d41-af9f-4081-8cbc-93dda97e5666 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.185177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cd00f-ae26-4fc0-8fa3-ea8cc1f037a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.185837 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cd00f-ae26-4fc0-8fa3-ea8cc1f037a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.186131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cd00f-ae26-4fc0-8fa3-ea8cc1f037a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.186418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cd00f-ae26-4fc0-8fa3-ea8cc1f037a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.187149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cd00f-ae26-4fc0-8fa3-ea8cc1f037a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.189362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cd00f-ae26-4fc0-8fa3-ea8cc1f037a0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.199865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1258/2511] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:06:57.204718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.214625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3f219-4207-4ab1-bb76-f224a8f5addd admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.219258 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.220135 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.220448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.220735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] PATH_INFO: `/v3/projects/b9ca993533c14b89b9aec7cd92b02b5a/users/b2f4fb1430cc44a399e5ee90c20a0739/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.236049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ca993533c14b89b9aec7cd92b02b5a, user_id=b2f4fb1430cc44a399e5ee90c20a0739, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.238742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.329720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1254/2512] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:06:57 2022] PUT /identity/v3/projects/b9ca993533c14b89b9aec7cd92b02b5a/users/b2f4fb1430cc44a399e5ee90c20a0739/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:06:57.340566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee67a8-6139-40de-a9fc-5d087c4466af None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.340864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee67a8-6139-40de-a9fc-5d087c4466af None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.341147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee67a8-6139-40de-a9fc-5d087c4466af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.368593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-dfee67a8-6139-40de-a9fc-5d087c4466af None None] MFA Rules not processed for user `b2f4fb1430cc44a399e5ee90c20a0739`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:57.370299 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-dfee67a8-6139-40de-a9fc-5d087c4466af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:57.434188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1259/2513] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:06:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:57.440658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.512885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5aede-d0af-42fd-ad5b-c03e900a352a admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.518441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.519104 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.519401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.519684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.520386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.522345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.648256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1255/2514] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:06:57 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:06:57.652256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee67a8-6139-40de-a9fc-5d087c4466af None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.663753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee67a8-6139-40de-a9fc-5d087c4466af None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.720765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.721431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.721722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.722005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.722700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.724645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.835557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1260/2515] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:06:57 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:06:57.839532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.850728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70227-4550-4241-a1d5-b750e9b5282c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.855306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.855964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.856256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.856573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.857300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.858915 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:57.870063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1256/2516] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:06:57.874156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:57.884232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddf7ee-a368-4513-a025-15b18e3eeb30 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:57.888907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:57.889813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:57.890099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:57.890377 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] PATH_INFO: `/v3/projects/3574c7fcb46949878780131dc348f30e/users/fc62196625b14c8b8c8108ddbfb40317/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:57.905621 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3574c7fcb46949878780131dc348f30e, user_id=fc62196625b14c8b8c8108ddbfb40317, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:57.909063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.024051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1261/2517] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:06:57 2022] PUT /identity/v3/projects/3574c7fcb46949878780131dc348f30e/users/fc62196625b14c8b8c8108ddbfb40317/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:06:58.027985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.039460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d764f-83ea-40d0-adf7-7772dfa3ea21 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.097090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e526ae-a7bf-4054-bb31-c78f4f9e70ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.097682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e526ae-a7bf-4054-bb31-c78f4f9e70ab admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.097970 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e526ae-a7bf-4054-bb31-c78f4f9e70ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.098247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e526ae-a7bf-4054-bb31-c78f4f9e70ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.098962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e526ae-a7bf-4054-bb31-c78f4f9e70ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.100603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e526ae-a7bf-4054-bb31-c78f4f9e70ab admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.110259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1257/2518] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:06:58 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:06:58.114433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.119876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:58.125402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b396e5-836b-4c0a-b79b-587fc024610a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.130107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.130981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.132091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.132091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] PATH_INFO: `/v3/projects/3574c7fcb46949878780131dc348f30e/users/fc62196625b14c8b8c8108ddbfb40317/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.133619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3574c7fcb46949878780131dc348f30e, user_id=fc62196625b14c8b8c8108ddbfb40317, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.136259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.148013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1262/2519] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:06:58 2022] PUT /identity/v3/projects/3574c7fcb46949878780131dc348f30e/users/fc62196625b14c8b8c8108ddbfb40317/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:06:58.158735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.159035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.159323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.165186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:06:58.186163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] MFA Rules not processed for user `fc62196625b14c8b8c8108ddbfb40317`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:06:58.189641 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:58.256535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1258/2520] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:06:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:06:58.268214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.269941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:58.351244 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667715e9-146a-483d-b6e7-f85c2ab2da01 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.354921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.355573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.355861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.356143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.365287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.366711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.376133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1263/2521] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:06:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:06:58.519223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:06:58.520662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:06:58.532666 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c78c8-9177-426d-9c80-c6816d95e439 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:06:58.536281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:06:58.537001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:06:58.537287 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:06:58.537571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:06:58.594875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:06:58.596370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:06:58.605427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1259/2522] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:06:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:00.086148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:00.087556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:00.177337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08aaaa3-75d6-4f71-a0ae-284340b6630c service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:00.182439 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c7429-152d-41c7-9903-02ff1bfbc239 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:00.183084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c7429-152d-41c7-9903-02ff1bfbc239 service placement] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:00.183376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c7429-152d-41c7-9903-02ff1bfbc239 service placement] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:00.183659 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c7429-152d-41c7-9903-02ff1bfbc239 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:00.185476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-133c7429-152d-41c7-9903-02ff1bfbc239 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:00.197641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c7429-152d-41c7-9903-02ff1bfbc239 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:00.199215 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c7429-152d-41c7-9903-02ff1bfbc239 service placement] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:00.209612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1264/2523] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:03.790714 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:03.868341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd20a6-315d-4bf9-9be7-0ee043b84300 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:03.872849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:03.873730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:03.874010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:03.874280 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] PATH_INFO: `/v3/users/b2f4fb1430cc44a399e5ee90c20a0739` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:03.875943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f4fb1430cc44a399e5ee90c20a0739)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:03.878198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:04.017733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:04.120625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f4fb1430cc44a399e5ee90c20a0739'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.195078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f4fb1430cc44a399e5ee90c20a0739'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.207460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f4fb1430cc44a399e5ee90c20a0739'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.214266 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f4fb1430cc44a399e5ee90c20a0739'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.214900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f4fb1430cc44a399e5ee90c20a0739'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:04.221300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1260/2524] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:03 2022] DELETE /identity/v3/users/b2f4fb1430cc44a399e5ee90c20a0739 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:04.226005 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:04.226509 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:04.226610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:04.245003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:04.246216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:04.284187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:04.305198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1265/2525] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:04.315566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:04.317119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:04.374515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0c9712-6e9c-43e1-bb4c-51dbb18e05aa admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:04.378966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:04.379610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:04.379899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:04.380183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:04.389378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:04.391509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:04.401543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1261/2526] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:04.860003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:04.861598 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:04.881989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c0f8f9-87a2-4422-8b57-45a345213f19 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:04.890631 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:04.891566 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:04.891857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:04.892136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] PATH_INFO: `/v3/projects/b9ca993533c14b89b9aec7cd92b02b5a` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:04.893619 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ca993533c14b89b9aec7cd92b02b5a)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:04.895778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:05.020816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ca993533c14b89b9aec7cd92b02b5a', 'request_id': 'req-8985a781-0b5d-4fb6-8c6e-9446885fc809'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.027198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ca993533c14b89b9aec7cd92b02b5a', 'request_id': 'req-8985a781-0b5d-4fb6-8c6e-9446885fc809'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.091654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ca993533c14b89b9aec7cd92b02b5a', 'request_id': 'req-8985a781-0b5d-4fb6-8c6e-9446885fc809'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.102905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] The token cache is being invalidate because project b9ca993533c14b89b9aec7cd92b02b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:05.103199 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.103836 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.105443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1266/2527] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:04 2022] DELETE /identity/v3/projects/b9ca993533c14b89b9aec7cd92b02b5a => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:05.110208 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:05.119767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4905c-e44d-4cc1-9943-4b96fa023916 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:05.176833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:05.177620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:05.177908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:05.178188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] PATH_INFO: `/v3/users/fc62196625b14c8b8c8108ddbfb40317` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:05.179382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc62196625b14c8b8c8108ddbfb40317)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:05.181395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:05.364936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc62196625b14c8b8c8108ddbfb40317'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.367460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:05.503781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc62196625b14c8b8c8108ddbfb40317'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.517539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc62196625b14c8b8c8108ddbfb40317'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.524609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc62196625b14c8b8c8108ddbfb40317'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.526050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-d67a3f3f-1d6b-48d1-baad-1678bfd77785 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc62196625b14c8b8c8108ddbfb40317'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:05.531429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1262/2528] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:05 2022] DELETE /identity/v3/users/fc62196625b14c8b8c8108ddbfb40317 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:06.030766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.033082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:06.046652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a781-0b5d-4fb6-8c6e-9446885fc809 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.105983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.106832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.107120 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.107418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] PATH_INFO: `/v3/projects/3574c7fcb46949878780131dc348f30e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.108656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3574c7fcb46949878780131dc348f30e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.111313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.206450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3574c7fcb46949878780131dc348f30e', 'request_id': 'req-3d275ed4-812d-4322-a877-7690a28f10a3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:06.212587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3574c7fcb46949878780131dc348f30e', 'request_id': 'req-3d275ed4-812d-4322-a877-7690a28f10a3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:06.320787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3574c7fcb46949878780131dc348f30e', 'request_id': 'req-3d275ed4-812d-4322-a877-7690a28f10a3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:06.325637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:06.332231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] The token cache is being invalidate because project 3574c7fcb46949878780131dc348f30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:06.332563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:06.333196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-3d275ed4-812d-4322-a877-7690a28f10a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:06.334735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1267/2529] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:06 2022] DELETE /identity/v3/projects/3574c7fcb46949878780131dc348f30e => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:06.339761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482607-23a0-44ab-9673-bf20dfc8cf15 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.340268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482607-23a0-44ab-9673-bf20dfc8cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.340368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3482607-23a0-44ab-9673-bf20dfc8cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.360672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c3482607-23a0-44ab-9673-bf20dfc8cf15 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:06.361869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c3482607-23a0-44ab-9673-bf20dfc8cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:06.420317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1263/2530] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:06.428171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8d482-1f63-47ca-a143-80a9c72da3c5 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.428488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8d482-1f63-47ca-a143-80a9c72da3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.428775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8d482-1f63-47ca-a143-80a9c72da3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.447225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6de8d482-1f63-47ca-a143-80a9c72da3c5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:06.448451 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6de8d482-1f63-47ca-a143-80a9c72da3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:06.457084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1268/2531] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:06.461152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482607-23a0-44ab-9673-bf20dfc8cf15 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.471263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3482607-23a0-44ab-9673-bf20dfc8cf15 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.475880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.476622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.476907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.477181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.477897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:06.478198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.479804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.491361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1264/2532] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:07:06.495705 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8d482-1f63-47ca-a143-80a9c72da3c5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.505143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8d482-1f63-47ca-a143-80a9c72da3c5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.509927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.510573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.510864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.511165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.511846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.513876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.630150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1269/2533] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:06 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:06.634247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.645098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46e9f6-06b8-4023-b750-f9221b9e1688 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.700801 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.701465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.701752 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.702036 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.702808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.705291 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.837953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1265/2534] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:06 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:06.842127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.852376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46106a04-1f5b-48d2-8796-9f321a5a0465 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.857048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.857704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.857992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.858277 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.859010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.860650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.871077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1270/2535] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:06.876384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.885744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5e1e1e-2c04-4af6-a085-b90bd36fbc01 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.891260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9405674-afbe-4645-b6bc-f73b1e376842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.891909 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405674-afbe-4645-b6bc-f73b1e376842 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.892197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405674-afbe-4645-b6bc-f73b1e376842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.892501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9405674-afbe-4645-b6bc-f73b1e376842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.893259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9405674-afbe-4645-b6bc-f73b1e376842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.894863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9405674-afbe-4645-b6bc-f73b1e376842 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:06.904802 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1266/2536] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:06.913110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:06.923331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaa68f-4a0f-4c86-add5-3ad2c3ebbaf8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:06.927938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:06.928861 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:06.929147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:06.929443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] PATH_INFO: `/v3/projects/fecccd55216c4792977a67fcb27d57f2/users/fe2970804bce4aa697e17592428309ec/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:06.944686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fecccd55216c4792977a67fcb27d57f2, user_id=fe2970804bce4aa697e17592428309ec, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:06.947345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.021323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1271/2537] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:06 2022] PUT /identity/v3/projects/fecccd55216c4792977a67fcb27d57f2/users/fe2970804bce4aa697e17592428309ec/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:07.033051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680a95-9083-4130-bc6d-172e9b1b243a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.033344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680a95-9083-4130-bc6d-172e9b1b243a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.033632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680a95-9083-4130-bc6d-172e9b1b243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.060527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b3680a95-9083-4130-bc6d-172e9b1b243a None None] MFA Rules not processed for user `fe2970804bce4aa697e17592428309ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:07.061720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b3680a95-9083-4130-bc6d-172e9b1b243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:07.082162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:07.125219 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1267/2538] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:07.136225 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:07.137906 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:07.196942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e61e752-27c9-4869-9e28-ef43340e060c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:07.200639 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48465275-947c-462f-b744-ab83254d041c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:07.201284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465275-947c-462f-b744-ab83254d041c service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.201575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465275-947c-462f-b744-ab83254d041c service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.201859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48465275-947c-462f-b744-ab83254d041c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.212278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465275-947c-462f-b744-ab83254d041c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:07.213748 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48465275-947c-462f-b744-ab83254d041c service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.222787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1272/2539] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:07.242479 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680a95-9083-4130-bc6d-172e9b1b243a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:07.307031 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680a95-9083-4130-bc6d-172e9b1b243a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:07.311616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:07.313195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.313472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.313745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] PATH_INFO: `/v3/users/fe2970804bce4aa697e17592428309ec` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.315026 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe2970804bce4aa697e17592428309ec)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:07.318157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.511038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe2970804bce4aa697e17592428309ec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:07.571743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe2970804bce4aa697e17592428309ec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:07.583723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe2970804bce4aa697e17592428309ec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:07.590710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe2970804bce4aa697e17592428309ec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:07.591371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe2970804bce4aa697e17592428309ec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:07.597876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1268/2540] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:07 2022] DELETE /identity/v3/users/fe2970804bce4aa697e17592428309ec => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:07.602549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.602851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.603141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.623601 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:07.625449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:07.694593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1273/2541] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:07.704091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:07.705644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:07.754200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:07.766349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84583-4759-44b8-a3af-072bd91560bc admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:07.770006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f056f9-280f-481d-bd69-7c54ef82620c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:07.770651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f056f9-280f-481d-bd69-7c54ef82620c service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:07.777872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f056f9-280f-481d-bd69-7c54ef82620c service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:07.777872 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f056f9-280f-481d-bd69-7c54ef82620c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:07.780142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f056f9-280f-481d-bd69-7c54ef82620c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:07.782205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f056f9-280f-481d-bd69-7c54ef82620c service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:07.791556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1269/2542] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:07:08.280054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:08.282670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:08.294912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c10e2f-0e15-4dfa-bd4f-048d823c6e21 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:08.300667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:08.301475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:08.301767 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:08.302153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] PATH_INFO: `/v3/projects/fecccd55216c4792977a67fcb27d57f2` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:08.303359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fecccd55216c4792977a67fcb27d57f2)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:08.305318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:08.420178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:08.434392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fecccd55216c4792977a67fcb27d57f2', 'request_id': 'req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:08.440908 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fecccd55216c4792977a67fcb27d57f2', 'request_id': 'req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:08.535402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fecccd55216c4792977a67fcb27d57f2', 'request_id': 'req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:08.546255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] The token cache is being invalidate because project fecccd55216c4792977a67fcb27d57f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:08.547152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:08.547795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-46a9ee57-72b9-4c5b-a08a-73397b0f8e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:08.549370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1274/2543] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:08 2022] DELETE /identity/v3/projects/fecccd55216c4792977a67fcb27d57f2 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:08.554231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733c375-23af-44cb-8993-d2a7e4b4270d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:08.554735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733c375-23af-44cb-8993-d2a7e4b4270d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:08.554735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733c375-23af-44cb-8993-d2a7e4b4270d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:08.572889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7733c375-23af-44cb-8993-d2a7e4b4270d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:08.574092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7733c375-23af-44cb-8993-d2a7e4b4270d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:08.633444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1270/2544] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:08.641151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ff35-8504-46ed-8b46-742872e228d2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:08.641442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ff35-8504-46ed-8b46-742872e228d2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:08.641722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ff35-8504-46ed-8b46-742872e228d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:08.660461 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-23b9ff35-8504-46ed-8b46-742872e228d2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:08.661721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-23b9ff35-8504-46ed-8b46-742872e228d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:08.669719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1275/2545] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:08.674571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733c375-23af-44cb-8993-d2a7e4b4270d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:08.684366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733c375-23af-44cb-8993-d2a7e4b4270d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:08.689713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:08.690400 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:08.690691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:08.690973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:08.691701 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:08.692011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:08.693922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:08.711149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1271/2546] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:07:08.712333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ff35-8504-46ed-8b46-742872e228d2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:08.722332 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ff35-8504-46ed-8b46-742872e228d2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:08.727175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:08.727952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:08.729683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:08.729683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:08.729683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:08.731167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:08.843478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1276/2547] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:08 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:08.847371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:08.857612 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e406971-2198-4019-8dd1-c03e9756138c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:08.915435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:08.916098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:08.916420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:08.916694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:08.917369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:08.919296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:08.994720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1272/2548] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:08 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:07:08.998880 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:09.009763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bbf5a-59ae-4e6f-9aed-8b53ecd63e96 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:09.014318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:09.014974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:09.015295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:09.015295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:09.016894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:09.018489 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:09.028858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1277/2549] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:09.032866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:09.042682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b5df1-66e9-4ad0-be6a-e0e973cdaa2f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:09.047345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c0294-9230-4887-a870-22300e638181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:09.047989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c0294-9230-4887-a870-22300e638181 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:09.048275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c0294-9230-4887-a870-22300e638181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:09.048581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c0294-9230-4887-a870-22300e638181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:09.049300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c0294-9230-4887-a870-22300e638181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:09.050911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c0294-9230-4887-a870-22300e638181 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:09.060711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1273/2550] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:09.065322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:09.075463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056359a-bd32-4648-ba4d-3b1a192ca09f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:09.081353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:09.082237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:09.082526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:09.082809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] PATH_INFO: `/v3/projects/323bbaa66425404e9cd08fff9b88c34d/users/5f191ac183434e7a9a0ea8d3ae7fdc5f/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:09.097475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=323bbaa66425404e9cd08fff9b88c34d, user_id=5f191ac183434e7a9a0ea8d3ae7fdc5f, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:09.100063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:09.177765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1278/2551] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:09 2022] PUT /identity/v3/projects/323bbaa66425404e9cd08fff9b88c34d/users/5f191ac183434e7a9a0ea8d3ae7fdc5f/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:07:09.189057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5963-c006-495d-b53a-4babc7cb791f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:09.189355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5963-c006-495d-b53a-4babc7cb791f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:09.189643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5963-c006-495d-b53a-4babc7cb791f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:09.219293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-612c5963-c006-495d-b53a-4babc7cb791f None None] MFA Rules not processed for user `5f191ac183434e7a9a0ea8d3ae7fdc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:09.220533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-612c5963-c006-495d-b53a-4babc7cb791f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:09.261710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:09.286936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1274/2552] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:09.298367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:09.300072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:09.356230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db51557-bf9f-420d-8631-b552175f4ac6 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:09.360568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a411d-6a4e-4a49-bc50-2b861fdf7df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:09.361216 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a411d-6a4e-4a49-bc50-2b861fdf7df6 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:09.361506 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a411d-6a4e-4a49-bc50-2b861fdf7df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:09.361789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a411d-6a4e-4a49-bc50-2b861fdf7df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:09.370648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a411d-6a4e-4a49-bc50-2b861fdf7df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:09.372068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a411d-6a4e-4a49-bc50-2b861fdf7df6 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:09.381611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1279/2553] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:07:19.332145 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=9 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:19.377681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:22.499558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5963-c006-495d-b53a-4babc7cb791f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:22.562084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5963-c006-495d-b53a-4babc7cb791f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:22.567144 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:22.568006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:22.568614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:22.568900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] PATH_INFO: `/v3/users/5f191ac183434e7a9a0ea8d3ae7fdc5f` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:22.570110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f191ac183434e7a9a0ea8d3ae7fdc5f)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:22.572058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:22.805851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f191ac183434e7a9a0ea8d3ae7fdc5f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:22.889143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f191ac183434e7a9a0ea8d3ae7fdc5f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:22.901902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f191ac183434e7a9a0ea8d3ae7fdc5f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:22.908812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f191ac183434e7a9a0ea8d3ae7fdc5f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:22.909592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f191ac183434e7a9a0ea8d3ae7fdc5f'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:22.915715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1275/2554] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:22 2022] DELETE /identity/v3/users/5f191ac183434e7a9a0ea8d3ae7fdc5f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:22.920319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:22.920834 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:22.920944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:22.938633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:22.940043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:23.000254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1280/2555] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:23.011359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:23.012871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:23.075185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d396d-752c-4ad8-b747-fcf5f700862f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:23.078657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d23b5-578a-4423-9b4d-7f972dee8734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:23.079443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d23b5-578a-4423-9b4d-7f972dee8734 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:23.079567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d23b5-578a-4423-9b4d-7f972dee8734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:23.079840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d23b5-578a-4423-9b4d-7f972dee8734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:23.088692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d23b5-578a-4423-9b4d-7f972dee8734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:23.090137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d23b5-578a-4423-9b4d-7f972dee8734 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:23.099989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1276/2556] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:23.530419 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:23.531857 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:23.545517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7eaca-8c81-4a20-8be4-f2adc6fdfecb None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:23.551025 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:23.563274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:23.563274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:23.563274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] PATH_INFO: `/v3/projects/323bbaa66425404e9cd08fff9b88c34d` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:23.563274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=323bbaa66425404e9cd08fff9b88c34d)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:23.563274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:23.699274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '323bbaa66425404e9cd08fff9b88c34d', 'request_id': 'req-29304485-c49f-4ed9-875c-57e85eede00b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:23.705577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '323bbaa66425404e9cd08fff9b88c34d', 'request_id': 'req-29304485-c49f-4ed9-875c-57e85eede00b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:23.777292 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '323bbaa66425404e9cd08fff9b88c34d', 'request_id': 'req-29304485-c49f-4ed9-875c-57e85eede00b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:23.788543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] The token cache is being invalidate because project 323bbaa66425404e9cd08fff9b88c34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:23.788838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:23.789476 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-29304485-c49f-4ed9-875c-57e85eede00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:23.791033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1281/2557] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:23 2022] DELETE /identity/v3/projects/323bbaa66425404e9cd08fff9b88c34d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:23.795761 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01780e55-1e90-4c08-a6e2-8556c8943e11 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:23.796234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01780e55-1e90-4c08-a6e2-8556c8943e11 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:23.796368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01780e55-1e90-4c08-a6e2-8556c8943e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:23.814158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-01780e55-1e90-4c08-a6e2-8556c8943e11 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:23.815986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-01780e55-1e90-4c08-a6e2-8556c8943e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:23.833561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:23.876459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1277/2558] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:23.884004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4978a-2adf-4a35-b790-44c486a329a2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:23.884296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4978a-2adf-4a35-b790-44c486a329a2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:23.884604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4978a-2adf-4a35-b790-44c486a329a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:23.903100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-13a4978a-2adf-4a35-b790-44c486a329a2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:23.904288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-13a4978a-2adf-4a35-b790-44c486a329a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:23.912804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1282/2559] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:23.916993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01780e55-1e90-4c08-a6e2-8556c8943e11 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:23.927842 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01780e55-1e90-4c08-a6e2-8556c8943e11 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:23.932561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:23.933214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:23.933533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:23.933814 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:23.934539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:23.934854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:23.936503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:23.948233 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1278/2560] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:07:23.952530 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4978a-2adf-4a35-b790-44c486a329a2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:23.961763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4978a-2adf-4a35-b790-44c486a329a2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:23.966482 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:23.967129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:23.967415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:23.967695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:23.968436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:23.970339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:24.092853 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1283/2561] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:23 2022] POST /identity/v3/projects => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:24.097468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:24.107587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cc2d3-12ea-4b1e-9223-36e831791c47 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:24.163696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:24.164369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:24.164690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:24.164973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:24.165670 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:24.167604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:24.277651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1279/2562] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:24 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:24.281640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:24.295054 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ccd15-07b8-439f-8e8c-3dedff70a98d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:24.300425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:24.301145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:24.301496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:24.301789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:24.302516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:24.304197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:24.314963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1284/2563] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:24.320019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:24.330248 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6169d81-a955-48c6-b0d1-e89fa4e3149f admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:24.336111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bc9fe-0a87-43c8-8664-91733d1f3fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:24.336797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bc9fe-0a87-43c8-8664-91733d1f3fef admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:24.337087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bc9fe-0a87-43c8-8664-91733d1f3fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:24.337369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bc9fe-0a87-43c8-8664-91733d1f3fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:24.338117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bc9fe-0a87-43c8-8664-91733d1f3fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:24.339741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bc9fe-0a87-43c8-8664-91733d1f3fef admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:24.350809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1280/2564] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:24.354911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:24.365329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f661b-b351-4beb-a542-9a8d6d3d54d7 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:24.369915 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:24.370786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:24.371074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:24.371356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] PATH_INFO: `/v3/projects/f887d6a4ef594b45898b23023c5f258e/users/a465994a91d84fceaa26dd4abd2d9ee7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:24.386382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f887d6a4ef594b45898b23023c5f258e, user_id=a465994a91d84fceaa26dd4abd2d9ee7, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:24.389083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:24.479422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1285/2565] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:24 2022] PUT /identity/v3/projects/f887d6a4ef594b45898b23023c5f258e/users/a465994a91d84fceaa26dd4abd2d9ee7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:24.489715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3107-c713-4346-99c9-c3e17ca28597 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:24.489960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3107-c713-4346-99c9-c3e17ca28597 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:24.490245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d3107-c713-4346-99c9-c3e17ca28597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:24.518746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-313d3107-c713-4346-99c9-c3e17ca28597 None None] MFA Rules not processed for user `a465994a91d84fceaa26dd4abd2d9ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:24.520095 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-313d3107-c713-4346-99c9-c3e17ca28597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:24.590194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1281/2566] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:24.628995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:24.630856 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:24.653852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:24.689281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ddd07-2d68-4bbf-b32c-7526ee0650bc admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:24.693755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581c469-4ae3-4baa-9032-ce42e450781d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:24.694392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c469-4ae3-4baa-9032-ce42e450781d service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:24.694687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c469-4ae3-4baa-9032-ce42e450781d service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:24.694965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581c469-4ae3-4baa-9032-ce42e450781d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:24.704916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581c469-4ae3-4baa-9032-ce42e450781d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:24.707115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581c469-4ae3-4baa-9032-ce42e450781d service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:24.717183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1286/2567] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:24.731343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d3107-c713-4346-99c9-c3e17ca28597 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:24.750567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:24.794353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d3107-c713-4346-99c9-c3e17ca28597 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:24.798943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:24.799828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:24.800119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:24.800416 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] PATH_INFO: `/v3/users/a465994a91d84fceaa26dd4abd2d9ee7` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:24.801633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a465994a91d84fceaa26dd4abd2d9ee7)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:24.803629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:25.051354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a465994a91d84fceaa26dd4abd2d9ee7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.111735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a465994a91d84fceaa26dd4abd2d9ee7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.124693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a465994a91d84fceaa26dd4abd2d9ee7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.132027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a465994a91d84fceaa26dd4abd2d9ee7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.133235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a465994a91d84fceaa26dd4abd2d9ee7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.138731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1282/2568] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:07:24 2022] DELETE /identity/v3/users/a465994a91d84fceaa26dd4abd2d9ee7 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:25.143941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:25.144450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:25.144624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:25.162077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:25.163265 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:25.223326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1287/2569] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:25.232929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:25.239294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:25.292535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061986fe-0211-47a1-839d-616aee013322 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:25.296039 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3330-386d-4b55-8762-592703436d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:25.296707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3330-386d-4b55-8762-592703436d52 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:25.296990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3330-386d-4b55-8762-592703436d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:25.297264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3330-386d-4b55-8762-592703436d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:25.306591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3330-386d-4b55-8762-592703436d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:25.308025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa3330-386d-4b55-8762-592703436d52 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:25.317418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1283/2570] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:25.708012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:25.709599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:25.722575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bc601-fcb7-4591-a698-6a48c749ff6b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:25.727418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:25.728136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:25.728448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:25.728722 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] PATH_INFO: `/v3/projects/f887d6a4ef594b45898b23023c5f258e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:25.729941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f887d6a4ef594b45898b23023c5f258e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:25.731886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:25.864132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f887d6a4ef594b45898b23023c5f258e', 'request_id': 'req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.870321 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f887d6a4ef594b45898b23023c5f258e', 'request_id': 'req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.942759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f887d6a4ef594b45898b23023c5f258e', 'request_id': 'req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.953782 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] The token cache is being invalidate because project f887d6a4ef594b45898b23023c5f258e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:07:25.954078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.954704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e96bb9d6-d7fb-4f53-864b-985f95b61e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:07:25.956362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1288/2571] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:07:25 2022] DELETE /identity/v3/projects/f887d6a4ef594b45898b23023c5f258e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:25.961407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70123c4-bcac-467d-9311-195974a9b67f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:25.961902 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70123c4-bcac-467d-9311-195974a9b67f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:25.962099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70123c4-bcac-467d-9311-195974a9b67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:25.980168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d70123c4-bcac-467d-9311-195974a9b67f None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:25.981405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d70123c4-bcac-467d-9311-195974a9b67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:26.015314 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:26.041056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1284/2572] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:07:26.048610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274e51-256c-4210-9b96-3b367e8386e0 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.048904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274e51-256c-4210-9b96-3b367e8386e0 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.049205 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08274e51-256c-4210-9b96-3b367e8386e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.069139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-08274e51-256c-4210-9b96-3b367e8386e0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:26.070352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-08274e51-256c-4210-9b96-3b367e8386e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:26.078383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1289/2573] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:26.082661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70123c4-bcac-467d-9311-195974a9b67f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.092179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70123c4-bcac-467d-9311-195974a9b67f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.097582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.098455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.098923 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.099576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.100355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:07:26.100707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.102332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.114428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1285/2574] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:07:26.118695 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08274e51-256c-4210-9b96-3b367e8386e0 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.127892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08274e51-256c-4210-9b96-3b367e8386e0 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.132749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.150142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.150142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.150142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.150142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.150142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.241466 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1290/2575] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:07:26 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:26.245662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.256439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59992-c7fb-4d52-b12e-679b2b2f98a9 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.313454 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.314121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.314410 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.314689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.315558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.317687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.429818 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1286/2576] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:07:26 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:07:26.433789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.444536 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5e84d-8a41-4365-b209-b73f5a16bf46 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.449144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.449799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.450086 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.450367 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.451115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.452729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.463755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1291/2577] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:07:26.467543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.478134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4b481-e73b-4d67-bb1a-5ac3433440bf admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.482796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39778c-a331-4527-b016-2fd905eef164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.483450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39778c-a331-4527-b016-2fd905eef164 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.483739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39778c-a331-4527-b016-2fd905eef164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.484022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39778c-a331-4527-b016-2fd905eef164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.484858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39778c-a331-4527-b016-2fd905eef164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.486476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39778c-a331-4527-b016-2fd905eef164 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.496735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1287/2578] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:07:26.500894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.511030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b567a42-61a2-4550-827e-0fb66693c595 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.515638 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.516552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.516874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.517161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] PATH_INFO: `/v3/projects/78d79d4d9816405eb0854a842fdf3c49/users/c43996f05e694f4bb2cfc971c91eb7c6/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.520122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:26.533044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d79d4d9816405eb0854a842fdf3c49, user_id=c43996f05e694f4bb2cfc971c91eb7c6, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.536923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.594679 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1292/2579] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:07:26 2022] PUT /identity/v3/projects/78d79d4d9816405eb0854a842fdf3c49/users/c43996f05e694f4bb2cfc971c91eb7c6/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:07:26.613940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.614240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.614524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.641142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] MFA Rules not processed for user `c43996f05e694f4bb2cfc971c91eb7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:07:26.642356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:26.706870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1288/2580] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:07:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:07:26.718753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:26.720508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:26.798258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cfd28c-9987-406a-a339-40750f6070b4 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:26.802127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de8dfe694ffb4716a09db9e1e6d9a9a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:26.802775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:26.803068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:26.803352 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:26.811691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:26.813196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:26.822487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1293/2581] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:07:32.019622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:32.021017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:32.062516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:32.127716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58505bae-1671-44ae-8ff2-844a3cc2d8fa None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:32.134361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:32.135119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:32.135493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:32.135824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:32.138509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:32.198014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:32.199625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:32.209568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1289/2582] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:07:36.818448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:42.204470 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=52 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:07:59.791121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:07:59.792606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:59.855003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb2100-7e4a-4f3a-b5db-3c2fc7e5f457 service glance] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:07:59.858686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:07:59.859325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:07:59.859610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:07:59.859885 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:07:59.861723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:07:59.943089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:07:59.944775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:07:59.962658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1294/2583] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:07:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:02.831645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:02.833206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:02.848305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac06772-9d10-472c-8a1b-15984c054efe service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:02.853993 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2461e-04dd-43c7-a023-2b0f68def314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:02.854632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2461e-04dd-43c7-a023-2b0f68def314 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:02.854921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2461e-04dd-43c7-a023-2b0f68def314 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:02.855203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2461e-04dd-43c7-a023-2b0f68def314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:02.856998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2df2461e-04dd-43c7-a023-2b0f68def314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:02.935523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2461e-04dd-43c7-a023-2b0f68def314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:02.937229 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2461e-04dd-43c7-a023-2b0f68def314 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:02.956788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1290/2584] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:09.959994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=61 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:12.953686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=41 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:22.378405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.440624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510251a3-7324-4544-b529-26c423a02de3 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.446082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.446938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.447226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.447507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] PATH_INFO: `/v3/users/c43996f05e694f4bb2cfc971c91eb7c6` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.448738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c43996f05e694f4bb2cfc971c91eb7c6)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.450692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.674809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c43996f05e694f4bb2cfc971c91eb7c6'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:22.755977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c43996f05e694f4bb2cfc971c91eb7c6'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:22.769924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c43996f05e694f4bb2cfc971c91eb7c6'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:22.777422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c43996f05e694f4bb2cfc971c91eb7c6'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:22.778096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c43996f05e694f4bb2cfc971c91eb7c6'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:22.784282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1295/2585] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:22 2022] DELETE /identity/v3/users/c43996f05e694f4bb2cfc971c91eb7c6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:22.789111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.789111 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.789805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.806586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:22.807788 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:22.878011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1291/2586] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:22.885422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:22.887029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:22.946246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4630d-a8b2-4469-b1f5-2a6a34982cc0 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:22.949874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59c82c-511f-4fd5-ab4d-ce63ef8557ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:22.950526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c82c-511f-4fd5-ab4d-ce63ef8557ab service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:22.950815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c82c-511f-4fd5-ab4d-ce63ef8557ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:22.951094 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59c82c-511f-4fd5-ab4d-ce63ef8557ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:22.960200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59c82c-511f-4fd5-ab4d-ce63ef8557ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:22.961810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59c82c-511f-4fd5-ab4d-ce63ef8557ab service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:22.971288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1296/2587] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:23.408427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:23.409999 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:23.423294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749177de-6ad4-470e-b628-b03208b437b3 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:23.428308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:23.429764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:23.437733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:23.437733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] PATH_INFO: `/v3/projects/78d79d4d9816405eb0854a842fdf3c49` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:23.437733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d79d4d9816405eb0854a842fdf3c49)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:23.437733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:23.554690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d79d4d9816405eb0854a842fdf3c49', 'request_id': 'req-593481c8-555b-4e4d-aa7c-9f5e08b0822c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:23.561150 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d79d4d9816405eb0854a842fdf3c49', 'request_id': 'req-593481c8-555b-4e4d-aa7c-9f5e08b0822c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:23.684555 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d79d4d9816405eb0854a842fdf3c49', 'request_id': 'req-593481c8-555b-4e4d-aa7c-9f5e08b0822c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:23.696354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] The token cache is being invalidate because project 78d79d4d9816405eb0854a842fdf3c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:23.696680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:23.697342 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-593481c8-555b-4e4d-aa7c-9f5e08b0822c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:23.698917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1292/2588] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:23 2022] DELETE /identity/v3/projects/78d79d4d9816405eb0854a842fdf3c49 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:23.703716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f88d2-3849-4573-8b45-0873b67b4fc7 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:23.704208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f88d2-3849-4573-8b45-0873b67b4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:23.704317 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f88d2-3849-4573-8b45-0873b67b4fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:23.722253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-0b9f88d2-3849-4573-8b45-0873b67b4fc7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:23.723457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0b9f88d2-3849-4573-8b45-0873b67b4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:23.740869 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:23.797185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1297/2589] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:23.802069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea121c-1c05-494a-9950-b41125a5fc19 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:23.802503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea121c-1c05-494a-9950-b41125a5fc19 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:23.802604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea121c-1c05-494a-9950-b41125a5fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:23.826942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-80ea121c-1c05-494a-9950-b41125a5fc19 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:23.828160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-80ea121c-1c05-494a-9950-b41125a5fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:23.837042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1293/2590] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:23.841095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f88d2-3849-4573-8b45-0873b67b4fc7 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:23.854562 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f88d2-3849-4573-8b45-0873b67b4fc7 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:23.859465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:23.860180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:23.860627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:23.860910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:23.862037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:08:23.862037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:23.864435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:23.882548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1298/2591] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:08:23.895209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea121c-1c05-494a-9950-b41125a5fc19 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:23.910253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea121c-1c05-494a-9950-b41125a5fc19 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:23.919887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:23.919887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:23.920382 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:23.920715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:23.921637 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:23.923780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:23.932859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:23.935241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:24.006349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68cedb2-a5a1-4e97-b694-28c1620166a9 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:24.010620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:24.011278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:24.011569 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:24.011852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:24.013670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:24.026516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:24.031368 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:24.037694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1299/2592] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:08:24.071432 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1294/2593] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:23 2022] POST /identity/v3/projects => generated 383 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:24.072634 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:24.084221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f4d7a-9b3a-4a9e-b4b2-72c52856238e service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:24.151012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:24.151694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:24.151987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:24.152270 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:24.153003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:24.154945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:24.271787 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1300/2594] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:24 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:24.277639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:24.290078 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8783a8-0390-466c-a725-f476815e93aa admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:24.295117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:24.295794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:24.296081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:24.296361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:24.297186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:24.300171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:24.313049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1295/2595] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:24.316914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:24.327961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0676bde-eab0-4a5a-9239-aa25e0b55932 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:24.332826 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7abe6f-e9a6-40b2-8ddd-fc8f5da2daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:24.335171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7abe6f-e9a6-40b2-8ddd-fc8f5da2daf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:24.335171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7abe6f-e9a6-40b2-8ddd-fc8f5da2daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:24.335171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7abe6f-e9a6-40b2-8ddd-fc8f5da2daf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:24.335171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7abe6f-e9a6-40b2-8ddd-fc8f5da2daf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:24.337772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7abe6f-e9a6-40b2-8ddd-fc8f5da2daf1 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:24.349559 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1301/2596] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:24.354759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:24.365347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72528db-9f51-4f0e-a1a8-2fdb24d4e9a7 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:24.373286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:24.373286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:24.373286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:24.373791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] PATH_INFO: `/v3/projects/48bc1d636aba41d1a3534c56e3a4ccda/users/36ce0ba640c045118116e1b68c4f3e63/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:24.391387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48bc1d636aba41d1a3534c56e3a4ccda, user_id=36ce0ba640c045118116e1b68c4f3e63, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:24.394460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:24.490810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1296/2597] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:24 2022] PUT /identity/v3/projects/48bc1d636aba41d1a3534c56e3a4ccda/users/36ce0ba640c045118116e1b68c4f3e63/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:24.497533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeadca-e1af-4075-8157-d99f4fed2640 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:24.497828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeadca-e1af-4075-8157-d99f4fed2640 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:24.498117 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eeadca-e1af-4075-8157-d99f4fed2640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:24.519535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e0eeadca-e1af-4075-8157-d99f4fed2640 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:24.521010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e0eeadca-e1af-4075-8157-d99f4fed2640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:24.556964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:24.604444 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1302/2598] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:24.613676 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:24.615422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:24.659319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:24.715623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e34475-5219-4f8e-93cc-fa97769618c8 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:24.721254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:24.722178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:24.722733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:24.723749 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:24.738521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:24.740703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:24.768753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1297/2599] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:26.653708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:26.654687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:26.655138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:26.684121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] MFA Rules not processed for user `36ce0ba640c045118116e1b68c4f3e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:26.685717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:26.774523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1303/2600] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:26.784195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:26.785730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:26.854353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b43b52-e1ca-42a1-a329-1eee17e0072b service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:26.858188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798f828-7b1d-482c-9eb3-9641e6e65400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:26.858840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f828-7b1d-482c-9eb3-9641e6e65400 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:26.859123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f828-7b1d-482c-9eb3-9641e6e65400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:26.859398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798f828-7b1d-482c-9eb3-9641e6e65400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:26.869153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798f828-7b1d-482c-9eb3-9641e6e65400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:26.870633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f798f828-7b1d-482c-9eb3-9641e6e65400 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:26.880523 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1298/2601] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:28.034888 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:28.037480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:28.114178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bf8a8-8984-4f30-b51f-3998a30b2428 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:28.122105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:28.123043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:28.123525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:28.126298 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:28.128313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:28.140831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:28.142405 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:28.153630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1304/2602] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:29.746709 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:29.747526 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:29.747966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:29.769864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] MFA Rules not processed for user `36ce0ba640c045118116e1b68c4f3e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:29.771269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:29.783438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1299/2603] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:30.055496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:30.066514 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76b988-0932-4701-b9c5-04cb12b6401a service placement] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:30.071804 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:30.072877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:30.073320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:30.073750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:30.075907 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:30.106758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:30.109458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:30.125373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1305/2604] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:32.231720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:32.233210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:32.248922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185443d-9c5a-4142-b19b-7abbfa2bd82f None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:32.254614 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:32.255288 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:32.255579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:32.255861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:32.258240 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:32.270372 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:32.271975 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:32.282689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1300/2605] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:32.432788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:32.434279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:32.449500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dd2bf9-ef3d-4544-94b9-a22f207149b1 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:32.454159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:32.455053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:32.455339 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:32.455622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] PATH_INFO: `/v3/users/315c0d9d9a284389ae07bf898c330605` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:32.456862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=315c0d9d9a284389ae07bf898c330605)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:32.458827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:32.792114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:32.807059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '315c0d9d9a284389ae07bf898c330605'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:32.864343 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:32.878632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff728c4b-d6e8-4c88-9e51-983f9119b115 service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:32.882446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:32.883088 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:32.883378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:32.883859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:32.885922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:32.898172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:32.899601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:32.909257 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1301/2606] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:08:32.910248 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '315c0d9d9a284389ae07bf898c330605'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:32.924200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '315c0d9d9a284389ae07bf898c330605'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:32.931674 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '315c0d9d9a284389ae07bf898c330605'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:32.932420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '315c0d9d9a284389ae07bf898c330605'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:32.938314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1306/2607] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:32 2022] DELETE /identity/v3/users/315c0d9d9a284389ae07bf898c330605 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:33.203745 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:33.218825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ca9cb-b865-49a5-80ce-d9291835a398 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:33.283404 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:33.284378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:33.284765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:33.285112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] PATH_INFO: `/v3/projects/b55a34a53b2740d9af5efd660424a456` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:33.286483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55a34a53b2740d9af5efd660424a456)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:33.288527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:33.390728 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:33.400733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55a34a53b2740d9af5efd660424a456', 'request_id': 'req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:33.408529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55a34a53b2740d9af5efd660424a456', 'request_id': 'req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:33.505195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55a34a53b2740d9af5efd660424a456', 'request_id': 'req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:33.514403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] The token cache is being invalidate because project b55a34a53b2740d9af5efd660424a456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:33.514657 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:33.515300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:33.519961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1302/2608] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:33 2022] DELETE /identity/v3/projects/b55a34a53b2740d9af5efd660424a456 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:33.521247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:33.523016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:33.541144 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5208dd7-3a8f-4b04-b4fd-941d2f7bcc9b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:33.599207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:33.601452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:33.602381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:33.602381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] PATH_INFO: `/v3/users/9ea80c41499244179f5e2c6530a1af08` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:33.618640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea80c41499244179f5e2c6530a1af08)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:33.622937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:33.890596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea80c41499244179f5e2c6530a1af08'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:33.997962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea80c41499244179f5e2c6530a1af08'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:34.034503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea80c41499244179f5e2c6530a1af08'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:34.057103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea80c41499244179f5e2c6530a1af08'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:34.057924 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea80c41499244179f5e2c6530a1af08'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:34.071283 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1307/2609] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:33 2022] DELETE /identity/v3/users/9ea80c41499244179f5e2c6530a1af08 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:34.516610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:34.518147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:34.532302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a28604-4e0f-4f7e-b07b-7dbdbc259d22 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:34.611772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:34.613223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:34.614014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:34.639451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] PATH_INFO: `/v3/projects/a39a4a9273514013bedc7ea4e4a2b2b9` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:34.639451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39a4a9273514013bedc7ea4e4a2b2b9)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:34.639451 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:34.861354 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39a4a9273514013bedc7ea4e4a2b2b9', 'request_id': 'req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:34.870804 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39a4a9273514013bedc7ea4e4a2b2b9', 'request_id': 'req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:35.011252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39a4a9273514013bedc7ea4e4a2b2b9', 'request_id': 'req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:35.028481 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] The token cache is being invalidate because project a39a4a9273514013bedc7ea4e4a2b2b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:35.029055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:35.030157 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:35.032758 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1303/2610] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:34 2022] DELETE /identity/v3/projects/a39a4a9273514013bedc7ea4e4a2b2b9 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:37.333528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:37.335012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:37.348556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33ef36-90ec-44af-a2c2-073f8e10a478 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:37.361409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:37.405217 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:37.406132 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:37.406420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:37.406699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] PATH_INFO: `/v3/users/b8d05eeb8ac146969b99d33084f1664c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:37.407886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d05eeb8ac146969b99d33084f1664c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:37.409974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:37.589232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d05eeb8ac146969b99d33084f1664c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:37.695529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d05eeb8ac146969b99d33084f1664c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:37.707786 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d05eeb8ac146969b99d33084f1664c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:37.715486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d05eeb8ac146969b99d33084f1664c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:37.716189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-e851928f-6799-4ad6-983d-596217f54c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d05eeb8ac146969b99d33084f1664c'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:37.722355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1308/2611] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:08:37 2022] DELETE /identity/v3/users/b8d05eeb8ac146969b99d33084f1664c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:38.077311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.078783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:38.092989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8f3bb4-3bf4-4726-a532-22b67eec4d58 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.137040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:38.152906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.153831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.154183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.154503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] PATH_INFO: `/v3/projects/8f72940f7df74b898595c0ed9c654502` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.155907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f72940f7df74b898595c0ed9c654502)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.157958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.283153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f72940f7df74b898595c0ed9c654502', 'request_id': 'req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:38.292525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f72940f7df74b898595c0ed9c654502', 'request_id': 'req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:38.364231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f72940f7df74b898595c0ed9c654502', 'request_id': 'req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:38.375738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] The token cache is being invalidate because project 8f72940f7df74b898595c0ed9c654502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:08:38.376034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:38.376702 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3bba974d-bb13-4e35-9bd2-f7d1888a1f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:08:38.378262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1304/2612] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:08:38 2022] DELETE /identity/v3/projects/8f72940f7df74b898595c0ed9c654502 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:38.384158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070153ae-1479-4f59-9683-d89546b87151 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.384666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070153ae-1479-4f59-9683-d89546b87151 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.384766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070153ae-1479-4f59-9683-d89546b87151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.402846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-070153ae-1479-4f59-9683-d89546b87151 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:38.404159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-070153ae-1479-4f59-9683-d89546b87151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:38.466142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1309/2613] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:38.474129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a910960-0598-448e-a802-1117d2c81e7c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.474421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a910960-0598-448e-a802-1117d2c81e7c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.474703 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a910960-0598-448e-a802-1117d2c81e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.496798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8a910960-0598-448e-a802-1117d2c81e7c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:38.498038 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8a910960-0598-448e-a802-1117d2c81e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:38.506348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1305/2614] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:38.511280 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070153ae-1479-4f59-9683-d89546b87151 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.521136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070153ae-1479-4f59-9683-d89546b87151 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.525902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.526557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.526846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.527129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.527854 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:08:38.528167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.529860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.541312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1310/2615] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:08:38.545421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a910960-0598-448e-a802-1117d2c81e7c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.555112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a910960-0598-448e-a802-1117d2c81e7c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.559785 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.560449 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.560740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.561019 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.561711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.563642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.677587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1306/2616] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:38 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:08:38.681644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.691575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0e8d3-301b-453e-9243-ea7e93ce9409 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.713372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:38.748390 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.749084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.749376 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.749689 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.750387 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.752311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.878761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1311/2617] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:38 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:38.883439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.893931 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b46f-265f-471c-ad28-513a23e062ce admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.899385 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.902687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.902687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.902687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.902687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.903127 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.913489 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1307/2618] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:38.917803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.931359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bcc8e2-6d51-468f-99a7-bb3efa16eca8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.932871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c457-cc3c-4d06-88d9-3360b4b56bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.933531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c457-cc3c-4d06-88d9-3360b4b56bea admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.933839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c457-cc3c-4d06-88d9-3360b4b56bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.934119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c457-cc3c-4d06-88d9-3360b4b56bea admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.934843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c457-cc3c-4d06-88d9-3360b4b56bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.936439 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c457-cc3c-4d06-88d9-3360b4b56bea admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:38.947492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1312/2619] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:38.951594 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:38.962196 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf843f-d390-46b3-92c4-52d6fa1ff2c3 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:38.966763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:38.967633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:38.967918 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:38.968199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] PATH_INFO: `/v3/projects/17b44f58e0f343fbb4c9ea0b61bfae82/users/9a0dcab275a84ae79fae3262022b546d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:38.983607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b44f58e0f343fbb4c9ea0b61bfae82, user_id=9a0dcab275a84ae79fae3262022b546d, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:38.986328 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:39.088054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1308/2620] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:38 2022] PUT /identity/v3/projects/17b44f58e0f343fbb4c9ea0b61bfae82/users/9a0dcab275a84ae79fae3262022b546d/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:39.098557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223973-10cb-4b82-9f6b-198ea3d3332e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.098855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223973-10cb-4b82-9f6b-198ea3d3332e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.099196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2223973-10cb-4b82-9f6b-198ea3d3332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.128171 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-e2223973-10cb-4b82-9f6b-198ea3d3332e None None] MFA Rules not processed for user `9a0dcab275a84ae79fae3262022b546d`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:39.129627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e2223973-10cb-4b82-9f6b-198ea3d3332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:39.198592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1313/2621] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:39.203083 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:39.264658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc9612-8488-4eda-b56f-92a6851967e3 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:39.269341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:39.269974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.270262 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.270549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.271232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:39.273255 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:39.286771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:39.416944 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1309/2622] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:08:39 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:39.421163 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223973-10cb-4b82-9f6b-198ea3d3332e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:39.432360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2223973-10cb-4b82-9f6b-198ea3d3332e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:39.491100 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:39.492326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.492661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.492948 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.493637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:39.495664 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:39.583876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1314/2623] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:08:39 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:08:39.587892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:39.598399 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab925a0d-4e58-434e-b989-20d2a280ed8e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:39.603591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:39.604248 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.604574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.604858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.605581 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:39.607183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:39.618214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1310/2624] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:39.622416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:39.632867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616944b0-2e4c-4c99-a184-73d8ae8639fd admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:39.637595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:39.638473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.638766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.639053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] PATH_INFO: `/v3/projects/5e85a3bb510f414793b10a9d9ee51eea/users/792d1cb453fa44598fb0ab16c433f248/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.654990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e85a3bb510f414793b10a9d9ee51eea, user_id=792d1cb453fa44598fb0ab16c433f248, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:39.657704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:39.738987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:39.745788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1315/2625] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:39 2022] PUT /identity/v3/projects/5e85a3bb510f414793b10a9d9ee51eea/users/792d1cb453fa44598fb0ab16c433f248/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:08:39.750387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:39.762076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a1b78-3127-4cf1-af51-a4cb3abb1b7c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:39.826904 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06414cab-bb26-49c5-974b-20a42e0df119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:39.827579 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414cab-bb26-49c5-974b-20a42e0df119 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.827864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414cab-bb26-49c5-974b-20a42e0df119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.828140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06414cab-bb26-49c5-974b-20a42e0df119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.828942 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414cab-bb26-49c5-974b-20a42e0df119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:39.830548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06414cab-bb26-49c5-974b-20a42e0df119 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:39.840692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1311/2626] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:08:39.844921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:39.855164 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074dbe2-b881-42d0-81a2-6bdeed95bbe8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:39.859770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:39.860672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.860956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.861234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] PATH_INFO: `/v3/projects/5e85a3bb510f414793b10a9d9ee51eea/users/792d1cb453fa44598fb0ab16c433f248/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.863151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e85a3bb510f414793b10a9d9ee51eea, user_id=792d1cb453fa44598fb0ab16c433f248, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:39.865772 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:39.876481 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1316/2627] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:08:39 2022] PUT /identity/v3/projects/5e85a3bb510f414793b10a9d9ee51eea/users/792d1cb453fa44598fb0ab16c433f248/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:08:39.892744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d209-5ae8-4dcb-8072-58e804c3b651 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:39.893042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d209-5ae8-4dcb-8072-58e804c3b651 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:39.893333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481d209-5ae8-4dcb-8072-58e804c3b651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:39.920264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-8481d209-5ae8-4dcb-8072-58e804c3b651 None None] MFA Rules not processed for user `792d1cb453fa44598fb0ab16c433f248`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:08:39.921576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-8481d209-5ae8-4dcb-8072-58e804c3b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:39.989721 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1312/2628] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:08:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:08:40.001439 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:40.003168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:08:40.060013 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c381e9-a444-42d4-b73e-46dec34b3c98 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:40.063771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:40.064422 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:40.064736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:40.065021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:40.076341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:40.078648 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:40.092729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1317/2629] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:08:40.351933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d209-5ae8-4dcb-8072-58e804c3b651 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:08:40.362011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481d209-5ae8-4dcb-8072-58e804c3b651 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:08:40.365696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:08:40.367058 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:08:40.367440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:08:40.367833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:08:40.432840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:08:40.434334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:08:40.444197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1313/2630] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:08:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:08:50.086507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:08:50.439742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:10.680326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:10.681847 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:10.738663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e33249-be61-46c6-803d-7cffe502f4ed service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:10.743236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1833dd-69de-4092-88d3-b72e06488e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:10.743874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1833dd-69de-4092-88d3-b72e06488e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:10.744157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1833dd-69de-4092-88d3-b72e06488e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:10.744462 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1833dd-69de-4092-88d3-b72e06488e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:10.746246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bd1833dd-69de-4092-88d3-b72e06488e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:10.817134 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1833dd-69de-4092-88d3-b72e06488e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:10.818576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1833dd-69de-4092-88d3-b72e06488e54 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:10.830062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1318/2631] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:09:12.012705 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:12.022762 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2340a301-d768-47d8-8cfa-ea9bd6e05cc3 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:12.026446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:12.027070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:12.027353 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:12.027631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:12.029427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:12.043249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:12.044723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:12.056109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1314/2632] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:09:20.825167 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=54 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:22.050633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=6 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:26.745104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d5e0f-7d34-4d3a-b55d-0000af54884f None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:26.745615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d5e0f-7d34-4d3a-b55d-0000af54884f None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:26.745758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d5e0f-7d34-4d3a-b55d-0000af54884f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:26.763024 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ea3d5e0f-7d34-4d3a-b55d-0000af54884f None None] MFA Rules not processed for user `36e78feea3104797a5e927c8ffb76d18`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:26.764237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ea3d5e0f-7d34-4d3a-b55d-0000af54884f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:26.820178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1319/2633] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:36.812998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=25 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:51.236953 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:51.299865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464001dd-c726-4bff-824c-c1e19a62c1f5 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:51.304967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:51.305835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:51.306482 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:51.306719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] PATH_INFO: `/v3/users/9a0dcab275a84ae79fae3262022b546d` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:51.307900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0dcab275a84ae79fae3262022b546d)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:51.309926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:51.524420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0dcab275a84ae79fae3262022b546d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:51.585223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0dcab275a84ae79fae3262022b546d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:51.597501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0dcab275a84ae79fae3262022b546d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:51.605322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0dcab275a84ae79fae3262022b546d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:51.605985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0dcab275a84ae79fae3262022b546d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:51.612059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1315/2634] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:09:51 2022] DELETE /identity/v3/users/9a0dcab275a84ae79fae3262022b546d => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:51.617300 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:51.617852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:51.617852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:51.635056 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:51.636278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:51.693128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1320/2635] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:51.702667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:51.704069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:51.760698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a0f4f-40f1-4366-9c31-b922154e8807 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:51.764313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:51.764989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:51.765275 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:51.765554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:51.775028 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:51.776511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:51.785906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1316/2636] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:09:52.220766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:52.220905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:52.236548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebfb32-9126-4280-a847-f8b2cdc2144c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:52.241260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:52.242345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:52.242593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:52.242876 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] PATH_INFO: `/v3/projects/17b44f58e0f343fbb4c9ea0b61bfae82` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:52.244110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b44f58e0f343fbb4c9ea0b61bfae82)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:52.246067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:52.360042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b44f58e0f343fbb4c9ea0b61bfae82', 'request_id': 'req-16995735-e31d-4e2b-85e1-8cd3a136398b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.366291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b44f58e0f343fbb4c9ea0b61bfae82', 'request_id': 'req-16995735-e31d-4e2b-85e1-8cd3a136398b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.459541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b44f58e0f343fbb4c9ea0b61bfae82', 'request_id': 'req-16995735-e31d-4e2b-85e1-8cd3a136398b'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.470815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] The token cache is being invalidate because project 17b44f58e0f343fbb4c9ea0b61bfae82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:09:52.472389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.472389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.473353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1321/2637] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:09:52 2022] DELETE /identity/v3/projects/17b44f58e0f343fbb4c9ea0b61bfae82 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:52.477669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:52.487452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53de07a5-a5be-41cd-87de-8a5d1e06ed26 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:52.506667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:52.546706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:52.547577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:52.547866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:52.548148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] PATH_INFO: `/v3/users/792d1cb453fa44598fb0ab16c433f248` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:52.549430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=792d1cb453fa44598fb0ab16c433f248)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:52.552638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:52.753411 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792d1cb453fa44598fb0ab16c433f248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.825004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792d1cb453fa44598fb0ab16c433f248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.837951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792d1cb453fa44598fb0ab16c433f248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.845237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792d1cb453fa44598fb0ab16c433f248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.845912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-3b21b3e5-68b9-48ed-81f8-5dda28189158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792d1cb453fa44598fb0ab16c433f248'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:52.852409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1317/2638] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:09:52 2022] DELETE /identity/v3/users/792d1cb453fa44598fb0ab16c433f248 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:53.358925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:53.360360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:53.374018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16995735-e31d-4e2b-85e1-8cd3a136398b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:53.432361 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:53.433254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:53.433549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:53.433832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] PATH_INFO: `/v3/projects/5e85a3bb510f414793b10a9d9ee51eea` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:53.435029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e85a3bb510f414793b10a9d9ee51eea)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:53.437077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:53.532091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:53.548991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e85a3bb510f414793b10a9d9ee51eea', 'request_id': 'req-dbfad79b-7551-4f01-976a-9290abe83bc4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:53.555431 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e85a3bb510f414793b10a9d9ee51eea', 'request_id': 'req-dbfad79b-7551-4f01-976a-9290abe83bc4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:53.633776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e85a3bb510f414793b10a9d9ee51eea', 'request_id': 'req-dbfad79b-7551-4f01-976a-9290abe83bc4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:53.644721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] The token cache is being invalidate because project 5e85a3bb510f414793b10a9d9ee51eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:09:53.645816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:53.645816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dbfad79b-7551-4f01-976a-9290abe83bc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:53.648465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1322/2639] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:09:53 2022] DELETE /identity/v3/projects/5e85a3bb510f414793b10a9d9ee51eea => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:53.653305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac528c4-ef62-448f-aedc-1cea8ad0016c None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:53.653771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac528c4-ef62-448f-aedc-1cea8ad0016c None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:53.653905 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac528c4-ef62-448f-aedc-1cea8ad0016c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:53.674435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-bac528c4-ef62-448f-aedc-1cea8ad0016c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:53.675677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bac528c4-ef62-448f-aedc-1cea8ad0016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:53.736601 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1318/2640] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:53.745230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e703-43a6-42cd-8bc8-c76a6b759a16 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:53.745657 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e703-43a6-42cd-8bc8-c76a6b759a16 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:53.746048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8318e703-43a6-42cd-8bc8-c76a6b759a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:53.765723 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-8318e703-43a6-42cd-8bc8-c76a6b759a16 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:53.766925 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8318e703-43a6-42cd-8bc8-c76a6b759a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:53.776040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1323/2641] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:53.780301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac528c4-ef62-448f-aedc-1cea8ad0016c None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:53.789917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac528c4-ef62-448f-aedc-1cea8ad0016c None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:53.794537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:53.795176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:53.795459 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:53.795737 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:53.796477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:09:53.796783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:53.798417 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:53.809876 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1319/2642] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:09:53.814121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e703-43a6-42cd-8bc8-c76a6b759a16 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:53.824784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8318e703-43a6-42cd-8bc8-c76a6b759a16 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:53.829636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:53.830284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:53.830576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:53.830859 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:53.831549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:53.833589 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:53.955630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1324/2643] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:09:53 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:53.960558 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:53.971000 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e998a-4fe0-4210-8a4e-0156df120c08 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:53.996979 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:54.027887 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.028585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.028871 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.029147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.029940 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.031861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.159812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1320/2644] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:09:53 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:54.161087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.171406 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88622805-a261-490e-a10a-8fbc524c8a55 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.176063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.176758 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.177043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.177324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.178109 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.180572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.191518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1325/2645] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:09:54.196786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.207237 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8be1d-7ac9-444a-b6f8-44ba8081e793 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.210801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.212640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:54.212819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.213494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.213808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.214085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.214819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.216486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.230247 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1321/2646] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:09:54.236224 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.251436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60019df6-b01c-43d4-8a0e-f9868dcf70e8 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.256559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.258620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.258620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.258825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] PATH_INFO: `/v3/projects/300b2ecaeeca49d1b84e52c39fbd9979/users/e9aeaf9507fa448e82996e35685eee49/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.278556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=300b2ecaeeca49d1b84e52c39fbd9979, user_id=e9aeaf9507fa448e82996e35685eee49, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.281208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866b082-33ed-4978-b1a7-09b0ea88bada admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.281647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.285174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe06c4e-d2a1-4b1f-8adf-7b92f51b6a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.285813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06c4e-d2a1-4b1f-8adf-7b92f51b6a7f service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.286104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06c4e-d2a1-4b1f-8adf-7b92f51b6a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.286425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe06c4e-d2a1-4b1f-8adf-7b92f51b6a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.288964 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6fe06c4e-d2a1-4b1f-8adf-7b92f51b6a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:54.299338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe06c4e-d2a1-4b1f-8adf-7b92f51b6a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.300815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe06c4e-d2a1-4b1f-8adf-7b92f51b6a7f service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.310147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1326/2647] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:09:54.356225 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1322/2648] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:09:54 2022] PUT /identity/v3/projects/300b2ecaeeca49d1b84e52c39fbd9979/users/e9aeaf9507fa448e82996e35685eee49/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:09:54.367435 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fa41-1929-4739-80d9-626f8dfad78e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.367960 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fa41-1929-4739-80d9-626f8dfad78e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.368087 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fa41-1929-4739-80d9-626f8dfad78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.399967 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-2f35fa41-1929-4739-80d9-626f8dfad78e None None] MFA Rules not processed for user `e9aeaf9507fa448e82996e35685eee49`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:54.401288 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2f35fa41-1929-4739-80d9-626f8dfad78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:54.466181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1327/2649] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:54.470537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.534638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c03d34-fee2-4a16-a338-9c25133ca8ba admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.539895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.540592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.540882 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.541163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.541849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.543787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.621179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1323/2650] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:09:54 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:54.625309 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35fa41-1929-4739-80d9-626f8dfad78e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.636245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35fa41-1929-4739-80d9-626f8dfad78e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.639838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:54.693088 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.693745 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.694060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.694363 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.695050 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.696993 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.768202 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1328/2651] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:09:54 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:54.772222 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.783316 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65de320-1896-4435-9bf0-1015f17018d8 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.788739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.789428 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.789724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.789996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.790722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.792348 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.802901 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1324/2652] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:09:54.807155 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.817383 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813dc29-db49-4886-aa4c-972985661c67 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:54.822213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:54.823091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:54.823379 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:54.823661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] PATH_INFO: `/v3/projects/d68e11fedcfb4ea5856988c62a1436a8/users/73d9a70d343045589170493d29f352f2/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:54.838930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68e11fedcfb4ea5856988c62a1436a8, user_id=73d9a70d343045589170493d29f352f2, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:54.841630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:54.948729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1329/2653] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:09:54 2022] PUT /identity/v3/projects/d68e11fedcfb4ea5856988c62a1436a8/users/73d9a70d343045589170493d29f352f2/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:54.952746 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:54.963654 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3234f7-16fc-4591-9d96-9dd497535dd3 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:55.014603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:55.020540 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb6f63-5cbd-4fe4-8583-a7a47672203c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:55.021174 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6f63-5cbd-4fe4-8583-a7a47672203c admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:55.021475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6f63-5cbd-4fe4-8583-a7a47672203c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:55.021775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb6f63-5cbd-4fe4-8583-a7a47672203c admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:55.023049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6f63-5cbd-4fe4-8583-a7a47672203c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:55.024920 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb6f63-5cbd-4fe4-8583-a7a47672203c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:55.034797 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1325/2654] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:09:55.044936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:55.055500 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da22a66-8078-4cea-9201-a4bf14ff58fa admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:55.060243 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:55.061147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:55.061437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:55.061719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] PATH_INFO: `/v3/projects/d68e11fedcfb4ea5856988c62a1436a8/users/73d9a70d343045589170493d29f352f2/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:55.063703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d68e11fedcfb4ea5856988c62a1436a8, user_id=73d9a70d343045589170493d29f352f2, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:55.066713 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:55.078560 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1330/2655] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:09:55 2022] PUT /identity/v3/projects/d68e11fedcfb4ea5856988c62a1436a8/users/73d9a70d343045589170493d29f352f2/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:55.089726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c341f65-36c3-4bfb-8635-d7d0760859e0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:55.090024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c341f65-36c3-4bfb-8635-d7d0760859e0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:55.090308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c341f65-36c3-4bfb-8635-d7d0760859e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:55.117103 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3c341f65-36c3-4bfb-8635-d7d0760859e0 None None] MFA Rules not processed for user `73d9a70d343045589170493d29f352f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:55.118315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3c341f65-36c3-4bfb-8635-d7d0760859e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:55.190123 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1326/2656] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:55.197957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:55.199672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:55.258113 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159569c0-0aa2-4b50-bc41-eaf14809a418 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:55.261892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41970fa9-9755-4453-883a-afe77444354b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:55.262543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970fa9-9755-4453-883a-afe77444354b service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:55.262829 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970fa9-9755-4453-883a-afe77444354b service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:55.263111 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41970fa9-9755-4453-883a-afe77444354b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:55.272136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41970fa9-9755-4453-883a-afe77444354b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:55.274286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41970fa9-9755-4453-883a-afe77444354b service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:55.283849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1331/2657] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:09:56.296199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c341f65-36c3-4bfb-8635-d7d0760859e0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.358878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c341f65-36c3-4bfb-8635-d7d0760859e0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.363472 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.364340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.364659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.364941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] PATH_INFO: `/v3/users/e9aeaf9507fa448e82996e35685eee49` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.366271 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9aeaf9507fa448e82996e35685eee49)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.368213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.559071 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9aeaf9507fa448e82996e35685eee49'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.654151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9aeaf9507fa448e82996e35685eee49'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.667163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9aeaf9507fa448e82996e35685eee49'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.674337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9aeaf9507fa448e82996e35685eee49'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.675043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9aeaf9507fa448e82996e35685eee49'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:56.676625 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:56.681997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1327/2658] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:09:56 2022] DELETE /identity/v3/users/e9aeaf9507fa448e82996e35685eee49 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:56.686840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.687334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.687442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.706762 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:56.708074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:56.777310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1332/2659] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:56.794192 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:56.795768 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:56.855478 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10920e74-0691-4e25-a17d-c4ae09baba69 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:56.859251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:56.859888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:56.860173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:56.860473 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:56.869638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:56.871090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:56.880582 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1328/2660] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:09:57.301223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:57.302734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:57.310827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:57.317362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3c303-0bed-4e96-863e-bfc7fb684efb None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:57.322926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:57.326879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:57.326879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:57.326879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] PATH_INFO: `/v3/projects/300b2ecaeeca49d1b84e52c39fbd9979` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:57.326879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300b2ecaeeca49d1b84e52c39fbd9979)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:57.328794 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:57.494517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300b2ecaeeca49d1b84e52c39fbd9979', 'request_id': 'req-2cbda809-9952-4af0-8985-c5e5d40e8d59'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:57.501000 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300b2ecaeeca49d1b84e52c39fbd9979', 'request_id': 'req-2cbda809-9952-4af0-8985-c5e5d40e8d59'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:57.596736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300b2ecaeeca49d1b84e52c39fbd9979', 'request_id': 'req-2cbda809-9952-4af0-8985-c5e5d40e8d59'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:57.608741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] The token cache is being invalidate because project 300b2ecaeeca49d1b84e52c39fbd9979 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:09:57.609047 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:57.609693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:57.611290 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1333/2661] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:09:57 2022] DELETE /identity/v3/projects/300b2ecaeeca49d1b84e52c39fbd9979 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:57.615527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:57.626910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d4aad-c6b7-4674-9e73-7e75cb509303 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:57.690610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:57.691571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:57.691858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:57.692136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] PATH_INFO: `/v3/users/73d9a70d343045589170493d29f352f2` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:57.693458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d9a70d343045589170493d29f352f2)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:57.695735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:57.885376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d9a70d343045589170493d29f352f2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.031033 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d9a70d343045589170493d29f352f2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.045383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d9a70d343045589170493d29f352f2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.052690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d9a70d343045589170493d29f352f2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.053401 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-9768faf9-b400-4116-80e1-9e20b2dad5cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d9a70d343045589170493d29f352f2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.060099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1329/2662] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:09:57 2022] DELETE /identity/v3/users/73d9a70d343045589170493d29f352f2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:58.521237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:58.523882 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:58.538278 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbda809-9952-4af0-8985-c5e5d40e8d59 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:58.602667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:58.603540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:58.603827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:58.604138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] PATH_INFO: `/v3/projects/d68e11fedcfb4ea5856988c62a1436a8` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:58.605373 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d68e11fedcfb4ea5856988c62a1436a8)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:58.607282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:58.745839 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd68e11fedcfb4ea5856988c62a1436a8', 'request_id': 'req-135de827-c1d0-4b62-88c8-c0e7cecd36bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.752491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd68e11fedcfb4ea5856988c62a1436a8', 'request_id': 'req-135de827-c1d0-4b62-88c8-c0e7cecd36bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.830756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd68e11fedcfb4ea5856988c62a1436a8', 'request_id': 'req-135de827-c1d0-4b62-88c8-c0e7cecd36bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.843186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] The token cache is being invalidate because project d68e11fedcfb4ea5856988c62a1436a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:09:58.843486 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.844773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-135de827-c1d0-4b62-88c8-c0e7cecd36bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:09:58.846447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1334/2663] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:09:58 2022] DELETE /identity/v3/projects/d68e11fedcfb4ea5856988c62a1436a8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:09:58.853090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bf40-5432-4c8d-b41b-7bdf0dc7f2c8 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:58.853623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bf40-5432-4c8d-b41b-7bdf0dc7f2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:58.853730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12bf40-5432-4c8d-b41b-7bdf0dc7f2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:58.873509 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3f12bf40-5432-4c8d-b41b-7bdf0dc7f2c8 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:58.874790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3f12bf40-5432-4c8d-b41b-7bdf0dc7f2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:58.889572 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:58.938687 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1330/2664] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:09:58.947335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7fa4-f9c4-49bf-bb2c-efb68ae1f334 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:58.947655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7fa4-f9c4-49bf-bb2c-efb68ae1f334 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:58.947942 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859a7fa4-f9c4-49bf-bb2c-efb68ae1f334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:58.967015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-859a7fa4-f9c4-49bf-bb2c-efb68ae1f334 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:58.968364 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-859a7fa4-f9c4-49bf-bb2c-efb68ae1f334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:58.977369 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1335/2665] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:58.981806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12bf40-5432-4c8d-b41b-7bdf0dc7f2c8 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:58.993178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12bf40-5432-4c8d-b41b-7bdf0dc7f2c8 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:58.997889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:58.998560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:58.998849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:58.999132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:58.999869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:09:59.000178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.001854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:59.016989 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1331/2666] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:09:59.018673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7fa4-f9c4-49bf-bb2c-efb68ae1f334 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:59.028371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859a7fa4-f9c4-49bf-bb2c-efb68ae1f334 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:59.033213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:59.033879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.034175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.034458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.035197 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.037179 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:59.042108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:59.138334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1336/2667] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:09:59 2022] POST /identity/v3/projects => generated 357 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:59.142530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:59.152847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568d7b-0cb3-478d-8d2a-b1d22777c60c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:59.209866 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:59.211130 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.211421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.211710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.212434 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.215552 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:59.339469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1332/2668] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:09:59 2022] POST /identity/v3/users => generated 279 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:09:59.340867 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:59.352862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed73ce3-1545-4eaf-a8d4-5ca74a566b7c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:59.358188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:59.359068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.359365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.359649 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.360385 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.362142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:59.373104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1337/2669] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:09:59.377277 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:59.388548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418404c-6424-4a64-9543-cbe5490b765b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:59.395857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26a0ed-e773-4d11-acbd-0182a4aef2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:59.395857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a0ed-e773-4d11-acbd-0182a4aef2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.395857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a0ed-e773-4d11-acbd-0182a4aef2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.395857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26a0ed-e773-4d11-acbd-0182a4aef2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.400048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a0ed-e773-4d11-acbd-0182a4aef2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.400048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26a0ed-e773-4d11-acbd-0182a4aef2c0 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:59.408542 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1333/2670] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:09:59.412591 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:59.424596 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c8331-0d07-4adc-9ad5-679c78ec4a36 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:59.430427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:59.431325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.431616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.431901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] PATH_INFO: `/v3/projects/3729739b7014455f831fe8fda7aa7282/users/0c9c4531ec6d4c46b46394ba99f2ca20/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.449242 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3729739b7014455f831fe8fda7aa7282, user_id=0c9c4531ec6d4c46b46394ba99f2ca20, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.452636 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:59.536250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1338/2671] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:09:59 2022] PUT /identity/v3/projects/3729739b7014455f831fe8fda7aa7282/users/0c9c4531ec6d4c46b46394ba99f2ca20/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:09:59.546708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4cd0-4cb4-4bd6-b79e-b37d7408552a None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.547008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4cd0-4cb4-4bd6-b79e-b37d7408552a None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.547304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c4cd0-4cb4-4bd6-b79e-b37d7408552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.578621 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-5b2c4cd0-4cb4-4bd6-b79e-b37d7408552a None None] MFA Rules not processed for user `0c9c4531ec6d4c46b46394ba99f2ca20`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:09:59.581128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5b2c4cd0-4cb4-4bd6-b79e-b37d7408552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:09:59.663899 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1334/2672] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:09:59 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:09:59.665443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:59.734662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116f022c-95b0-420e-aa48-97ff886d75ba admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:59.739375 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:59.740044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.740336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.740652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.742032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.744124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:09:59.869891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1339/2673] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:09:59 2022] POST /identity/v3/projects => generated 355 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:09:59.871304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4cd0-4cb4-4bd6-b79e-b37d7408552a None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:09:59.885598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c4cd0-4cb4-4bd6-b79e-b37d7408552a None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:09:59.901799 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:09:59.951525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:09:59.952114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:09:59.952424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:09:59.952939 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:09:59.953409 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:09:59.955458 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:00.058299 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1335/2674] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:09:59 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:10:00.062351 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:00.074188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b210-9f4b-4d5c-9d51-8975ff95f136 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:00.078990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:00.079668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:00.079955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:00.080234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:00.081046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:00.082666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:00.094181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1340/2675] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:10:00.099455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:00.110397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b13abe-dd12-4111-96d2-04973655f102 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:00.115182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:00.116787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:00.117149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:00.117423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] PATH_INFO: `/v3/projects/146cae991f7345a4a2a60840357bf828/users/66b68b6b69d04696aab759f50bca3c01/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:00.137008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146cae991f7345a4a2a60840357bf828, user_id=66b68b6b69d04696aab759f50bca3c01, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:00.139677 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:00.251742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1336/2676] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:10:00 2022] PUT /identity/v3/projects/146cae991f7345a4a2a60840357bf828/users/66b68b6b69d04696aab759f50bca3c01/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:00.256253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:00.271436 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d425c517-e65e-4bb6-aac5-099db8bbc718 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:00.340576 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8fc96-203f-402c-a106-cec974d13c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:00.341169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8fc96-203f-402c-a106-cec974d13c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:00.341457 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8fc96-203f-402c-a106-cec974d13c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:00.341734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8fc96-203f-402c-a106-cec974d13c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:00.342459 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8fc96-203f-402c-a106-cec974d13c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:00.344069 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8fc96-203f-402c-a106-cec974d13c5d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:00.354883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1341/2677] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:10:00.359106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:00.374501 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77343f3-60b6-425b-a4a7-c190dda876d2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:00.381518 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:00.383148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:00.383436 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:00.383716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] PATH_INFO: `/v3/projects/146cae991f7345a4a2a60840357bf828/users/66b68b6b69d04696aab759f50bca3c01/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:00.385831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=146cae991f7345a4a2a60840357bf828, user_id=66b68b6b69d04696aab759f50bca3c01, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:00.388525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:00.400124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1337/2678] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:10:00 2022] PUT /identity/v3/projects/146cae991f7345a4a2a60840357bf828/users/66b68b6b69d04696aab759f50bca3c01/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:00.411666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150da66-9a89-4ebd-9789-bc7e36921e6a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:00.415296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150da66-9a89-4ebd-9789-bc7e36921e6a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:00.415296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150da66-9a89-4ebd-9789-bc7e36921e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:00.439556 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-8150da66-9a89-4ebd-9789-bc7e36921e6a None None] MFA Rules not processed for user `66b68b6b69d04696aab759f50bca3c01`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:00.441116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8150da66-9a89-4ebd-9789-bc7e36921e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:00.450936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:00.516891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1342/2679] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:00 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:00.581722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:00.583480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:00.640719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cd242-77bb-4c9d-8219-a3262ad11212 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:00.644231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d85aaa-7064-4945-a843-f4638ffc6c01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:00.644907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85aaa-7064-4945-a843-f4638ffc6c01 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:00.645198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85aaa-7064-4945-a843-f4638ffc6c01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:00.645477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d85aaa-7064-4945-a843-f4638ffc6c01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:00.668315 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d85aaa-7064-4945-a843-f4638ffc6c01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:00.669810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d85aaa-7064-4945-a843-f4638ffc6c01 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:00.684753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1338/2680] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:00 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:00.966768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150da66-9a89-4ebd-9789-bc7e36921e6a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:00.976858 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150da66-9a89-4ebd-9789-bc7e36921e6a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:00.980480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:00.981126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:00.981416 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:00.981702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:01.040702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:01.042181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:01.051355 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1343/2681] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:00 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:10.677796 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:11.047131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=52 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:18.879293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3926-984a-4a0e-a092-c084fea0381d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:18.879828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3926-984a-4a0e-a092-c084fea0381d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:18.879948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3926-984a-4a0e-a092-c084fea0381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:18.898567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-906b3926-984a-4a0e-a092-c084fea0381d None None] MFA Rules not processed for user `36ce0ba640c045118116e1b68c4f3e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:18.899781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-906b3926-984a-4a0e-a092-c084fea0381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:18.955824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1339/2682] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:28.300587 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:28.364330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861b70-bc8c-463e-9f3c-52dc45074bcf service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:28.368929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:28.370104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:28.370388 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:28.370676 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] PATH_INFO: `/v3/users/0c9c4531ec6d4c46b46394ba99f2ca20` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:28.371864 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c9c4531ec6d4c46b46394ba99f2ca20)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:28.373846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:28.585985 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c9c4531ec6d4c46b46394ba99f2ca20'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:28.666852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c9c4531ec6d4c46b46394ba99f2ca20'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:28.679518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c9c4531ec6d4c46b46394ba99f2ca20'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:28.686983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c9c4531ec6d4c46b46394ba99f2ca20'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:28.687644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c9c4531ec6d4c46b46394ba99f2ca20'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:28.694350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1344/2683] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:10:28 2022] DELETE /identity/v3/users/0c9c4531ec6d4c46b46394ba99f2ca20 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:28.700061 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:28.700608 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:28.700708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:28.719916 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:28.721213 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:28.781720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1340/2684] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:28.794156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:28.795666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:28.855434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1d6e0-286e-4b31-b004-20b0cbd704bb admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:28.859108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:28.859817 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:28.860103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:28.860384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:28.870895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:28.872384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:28.881914 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1345/2685] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:29.327016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:29.328613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:29.343131 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fbe8c-a7e5-430e-a2e4-9f9422b51cc9 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:29.347987 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:29.349152 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:29.351015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:29.351015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] PATH_INFO: `/v3/projects/3729739b7014455f831fe8fda7aa7282` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:29.351015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3729739b7014455f831fe8fda7aa7282)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:29.352929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:29.490734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3729739b7014455f831fe8fda7aa7282', 'request_id': 'req-63a01124-aa7a-42ab-93a7-419e7b9e4109'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:29.499337 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3729739b7014455f831fe8fda7aa7282', 'request_id': 'req-63a01124-aa7a-42ab-93a7-419e7b9e4109'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:29.604733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3729739b7014455f831fe8fda7aa7282', 'request_id': 'req-63a01124-aa7a-42ab-93a7-419e7b9e4109'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:29.616502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] The token cache is being invalidate because project 3729739b7014455f831fe8fda7aa7282 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:10:29.616900 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:29.617535 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:29.619112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1341/2686] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:10:29 2022] DELETE /identity/v3/projects/3729739b7014455f831fe8fda7aa7282 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:29.623271 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:29.634511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e2797-ee69-448d-88f2-ef476fd13d77 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:29.654212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:29.692502 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:29.698487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:29.698487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:29.698487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] PATH_INFO: `/v3/users/66b68b6b69d04696aab759f50bca3c01` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:29.698487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b68b6b69d04696aab759f50bca3c01)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:29.698487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:29.956043 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b68b6b69d04696aab759f50bca3c01'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.061780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b68b6b69d04696aab759f50bca3c01'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.075009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b68b6b69d04696aab759f50bca3c01'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.081741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b68b6b69d04696aab759f50bca3c01'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.082522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-236d1677-cffd-46a3-83e9-e7fc27f3e001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b68b6b69d04696aab759f50bca3c01'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.089008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1346/2687] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:10:29 2022] DELETE /identity/v3/users/66b68b6b69d04696aab759f50bca3c01 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:30.529613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:30.531185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:30.547423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a01124-aa7a-42ab-93a7-419e7b9e4109 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:30.575771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:30.606505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:30.607303 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:30.607623 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:30.607907 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] PATH_INFO: `/v3/projects/146cae991f7345a4a2a60840357bf828` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:30.609140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=146cae991f7345a4a2a60840357bf828)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:30.611149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:30.724182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '146cae991f7345a4a2a60840357bf828', 'request_id': 'req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.730667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '146cae991f7345a4a2a60840357bf828', 'request_id': 'req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.881408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '146cae991f7345a4a2a60840357bf828', 'request_id': 'req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.893185 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] The token cache is being invalidate because project 146cae991f7345a4a2a60840357bf828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:10:30.893476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.894153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f910a0f9-2bf5-4686-a2a9-c31ebbf28445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:30.896014 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1342/2688] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:10:30 2022] DELETE /identity/v3/projects/146cae991f7345a4a2a60840357bf828 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:30.901078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e477a9-76a1-4e76-818b-d6ead9326db3 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:30.901593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e477a9-76a1-4e76-818b-d6ead9326db3 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:30.906543 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e477a9-76a1-4e76-818b-d6ead9326db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:30.919846 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f0e477a9-76a1-4e76-818b-d6ead9326db3 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:30.921075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f0e477a9-76a1-4e76-818b-d6ead9326db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:31.121797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1347/2689] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:10:31.129946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246aaef-a211-4373-81ef-b3d27cb1ab98 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.130241 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246aaef-a211-4373-81ef-b3d27cb1ab98 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.131140 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246aaef-a211-4373-81ef-b3d27cb1ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.149168 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-0246aaef-a211-4373-81ef-b3d27cb1ab98 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:31.150386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-0246aaef-a211-4373-81ef-b3d27cb1ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:31.159010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1343/2690] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:31.163729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e477a9-76a1-4e76-818b-d6ead9326db3 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.174207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e477a9-76a1-4e76-818b-d6ead9326db3 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.179064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.179749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.180032 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.180308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.181071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:10:31.181378 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.182960 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.199651 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1348/2691] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:10:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:10:31.201068 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246aaef-a211-4373-81ef-b3d27cb1ab98 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.213715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0246aaef-a211-4373-81ef-b3d27cb1ab98 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.218981 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.219630 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.219912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.220333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.221054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.222996 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.334344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1344/2692] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:10:31 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:10:31.338275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.348365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53310b15-71b3-4c5a-b205-01b1c2ab3458 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.375788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:31.407487 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.408097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.408443 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.408727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.409491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.411414 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.470930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.473015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:31.535810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1349/2693] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:10:31 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:10:31.539987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.549507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200c1b9-dde7-40e4-8e14-4280f1dbca6c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.550759 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490f5e5-7659-4ede-b69a-dee4f9017649 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.554754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.555301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.555460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.555628 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.555905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.556042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.556223 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.556543 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.556691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.558310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.558554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:31.571488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1350/2694] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:10:31.571827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.572766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.573235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.584372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de29ad-d27a-4f65-b4c6-989a352e45fb admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.586161 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1345/2695] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:10:31.590391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2191d3c-3142-44ba-bdb7-ecd33897884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.591185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191d3c-3142-44ba-bdb7-ecd33897884d admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.591971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191d3c-3142-44ba-bdb7-ecd33897884d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.592157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2191d3c-3142-44ba-bdb7-ecd33897884d admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.593030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2191d3c-3142-44ba-bdb7-ecd33897884d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.594818 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2191d3c-3142-44ba-bdb7-ecd33897884d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.607966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1351/2696] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:10:31.616587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.628357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdcd55b-320b-4e9a-89c5-3a12ba4dec6f service nova] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.633203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.634092 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.634537 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.634828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] PATH_INFO: `/v3/projects/fb1f42bb7a1447c199926c60e648d33f/users/86eb37a1d1b144f9ac4409f6fb19c36c/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.647483 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:31.650530 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1f42bb7a1447c199926c60e648d33f, user_id=86eb37a1d1b144f9ac4409f6fb19c36c, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.653910 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:31.736960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1346/2697] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:10:31 2022] PUT /identity/v3/projects/fb1f42bb7a1447c199926c60e648d33f/users/86eb37a1d1b144f9ac4409f6fb19c36c/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:31.747330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fbf8-01f5-42de-9d78-4f39e8abf392 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.747652 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fbf8-01f5-42de-9d78-4f39e8abf392 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.747949 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917fbf8-01f5-42de-9d78-4f39e8abf392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.775104 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5917fbf8-01f5-42de-9d78-4f39e8abf392 None None] MFA Rules not processed for user `86eb37a1d1b144f9ac4409f6fb19c36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:31.782232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5917fbf8-01f5-42de-9d78-4f39e8abf392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:31.843141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1352/2698] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:31.847620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:31.911486 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f265a-8654-448c-a634-5e6fe4548b34 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:31.916532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:31.917198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:31.917487 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:31.918197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:31.918719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:31.920734 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:32.018531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1347/2699] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:10:31 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:10:32.019979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917fbf8-01f5-42de-9d78-4f39e8abf392 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:32.031245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917fbf8-01f5-42de-9d78-4f39e8abf392 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:32.085887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:32.086538 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:32.086822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:32.087099 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:32.087797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:32.090320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:32.161237 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1353/2700] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:10:32 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:10:32.165246 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:32.176143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea20e71-f66e-45ae-8cd9-6c1c95be287e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:32.180852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:32.181522 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:32.181813 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:32.182098 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:32.182857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:32.185002 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:32.196164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1348/2701] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:10:32.201048 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:32.211121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f1706c-a522-4271-9a3e-df3b74fa7988 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:32.215878 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:32.216790 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:32.217077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:32.217356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] PATH_INFO: `/v3/projects/fbec0072ea2c4607b0368d4fc4db848f/users/a5260e7b9f6f4aeea2e82dae5807927a/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:32.230450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:32.233877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbec0072ea2c4607b0368d4fc4db848f, user_id=a5260e7b9f6f4aeea2e82dae5807927a, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:32.236602 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:32.335627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1354/2702] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:10:32 2022] PUT /identity/v3/projects/fbec0072ea2c4607b0368d4fc4db848f/users/a5260e7b9f6f4aeea2e82dae5807927a/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:32.340672 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:32.350226 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86a28e-52d3-4c83-94f4-93f79b7ee492 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:32.408967 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79bda7-60ca-4e6d-90ff-3ef36f8cfd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:32.409633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bda7-60ca-4e6d-90ff-3ef36f8cfd20 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:32.409950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bda7-60ca-4e6d-90ff-3ef36f8cfd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:32.410232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bda7-60ca-4e6d-90ff-3ef36f8cfd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:32.410986 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79bda7-60ca-4e6d-90ff-3ef36f8cfd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:32.412659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79bda7-60ca-4e6d-90ff-3ef36f8cfd20 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:32.422392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1349/2703] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:10:32.426496 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:32.437209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0df7-a037-4c2b-8725-dff31952b9ee admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:32.441996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:32.442865 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:32.443145 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:32.443418 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] PATH_INFO: `/v3/projects/fbec0072ea2c4607b0368d4fc4db848f/users/a5260e7b9f6f4aeea2e82dae5807927a/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:32.445404 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbec0072ea2c4607b0368d4fc4db848f, user_id=a5260e7b9f6f4aeea2e82dae5807927a, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:32.447991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:32.458916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1355/2704] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:10:32 2022] PUT /identity/v3/projects/fbec0072ea2c4607b0368d4fc4db848f/users/a5260e7b9f6f4aeea2e82dae5807927a/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:32.470304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8729a-559b-4804-b913-cebe7c26d932 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:32.470602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8729a-559b-4804-b913-cebe7c26d932 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:32.470884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8729a-559b-4804-b913-cebe7c26d932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:32.507340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-51f8729a-559b-4804-b913-cebe7c26d932 None None] MFA Rules not processed for user `a5260e7b9f6f4aeea2e82dae5807927a`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:32.508578 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-51f8729a-559b-4804-b913-cebe7c26d932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:32.560985 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:32.581101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1350/2705] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:32 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:32.593356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:32.595051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:32.653146 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd1664-014d-4bf2-904a-400b34747a81 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:32.657055 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:32.657702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:32.658039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:32.658324 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:32.668557 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:32.670263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:32.679879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1356/2706] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:32 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:33.628427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8729a-559b-4804-b913-cebe7c26d932 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:33.638232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8729a-559b-4804-b913-cebe7c26d932 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:33.642828 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5260e7b9f6f4aeea2e82dae5807927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbec0072ea2c4607b0368d4fc4db848f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:33.643420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:33.643706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:33.643984 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:33.644743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:10:33.645050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:33.646659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:33.658163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1351/2707] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:10:33.662209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:33.672744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab81a4-4934-465e-9af7-3c6421b4277d service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:33.677391 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5260e7b9f6f4aeea2e82dae5807927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbec0072ea2c4607b0368d4fc4db848f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:33.678052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:33.678345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:33.678630 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:33.679334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:33.681294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:33.843610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1357/2708] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:10:33 2022] POST /identity/v3/projects => generated 354 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:10:33.847767 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:33.858321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8ef57-3711-4ae3-81ad-857eba2cf0fa tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:33.914785 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5260e7b9f6f4aeea2e82dae5807927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbec0072ea2c4607b0368d4fc4db848f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:33.915369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:33.915662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:33.915950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:33.916713 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:10:33.917029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:33.919427 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:33.931124 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1352/2709] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:10:33.967291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:33.977665 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ef730-8cee-412d-b3e2-1176a1ccfb6f tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:33.982887 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5260e7b9f6f4aeea2e82dae5807927a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fbec0072ea2c4607b0368d4fc4db848f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:33.983740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:33.984033 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:33.984313 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] PATH_INFO: `/v3/projects/947f0550a58449649555683765bbe077` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:33.985558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=947f0550a58449649555683765bbe077)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:33.987447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:34.090568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947f0550a58449649555683765bbe077', 'request_id': 'req-2107f30a-a99d-4b3a-b00f-74db4c883a71'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:34.097158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947f0550a58449649555683765bbe077', 'request_id': 'req-2107f30a-a99d-4b3a-b00f-74db4c883a71'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:34.166671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947f0550a58449649555683765bbe077', 'request_id': 'req-2107f30a-a99d-4b3a-b00f-74db4c883a71'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:34.177285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] The token cache is being invalidate because project 947f0550a58449649555683765bbe077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:10:34.177577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:34.178221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2107f30a-a99d-4b3a-b00f-74db4c883a71 tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:34.179812 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1358/2710] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:10:33 2022] DELETE /identity/v3/projects/947f0550a58449649555683765bbe077 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:34.777336 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:34.779324 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:34.861384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded219-8a2f-49d1-892f-bfb80736e65d tempest-VolumeQuotaClassesTest-960668772 tempest-VolumeQuotaClassesTest-960668772-project-admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:34.923252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:34.924139 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:34.929727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:34.929727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] PATH_INFO: `/v3/users/86eb37a1d1b144f9ac4409f6fb19c36c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:34.929727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86eb37a1d1b144f9ac4409f6fb19c36c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:34.929727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:34.945006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:35.155500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86eb37a1d1b144f9ac4409f6fb19c36c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:35.249690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86eb37a1d1b144f9ac4409f6fb19c36c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:35.262134 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86eb37a1d1b144f9ac4409f6fb19c36c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:35.268911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86eb37a1d1b144f9ac4409f6fb19c36c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:35.269554 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86eb37a1d1b144f9ac4409f6fb19c36c'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:35.275528 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1353/2711] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:10:34 2022] DELETE /identity/v3/users/86eb37a1d1b144f9ac4409f6fb19c36c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:35.280577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:35.281084 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:35.281188 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:35.300228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:35.301464 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:35.339992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:35.361318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1359/2712] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:35.371001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:35.372590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:35.430173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e39566-5e9c-4357-abfd-b0c92196ee82 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:35.433831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:35.434592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:35.434885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:35.435167 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:35.445188 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:35.449568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:35.456529 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1354/2713] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:35.903236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:35.904741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:35.918901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d461e-e986-48d9-b6d3-439191396a8d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:35.924505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:35.926064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:35.926701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:35.927003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] PATH_INFO: `/v3/projects/fb1f42bb7a1447c199926c60e648d33f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:35.928432 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1f42bb7a1447c199926c60e648d33f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:35.934975 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:36.053232 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1f42bb7a1447c199926c60e648d33f', 'request_id': 'req-8150f3ac-3453-4202-b950-17ef81a7c207'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.060577 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1f42bb7a1447c199926c60e648d33f', 'request_id': 'req-8150f3ac-3453-4202-b950-17ef81a7c207'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.146616 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1f42bb7a1447c199926c60e648d33f', 'request_id': 'req-8150f3ac-3453-4202-b950-17ef81a7c207'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.157408 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] The token cache is being invalidate because project fb1f42bb7a1447c199926c60e648d33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:10:36.157700 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.158350 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.159896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1360/2714] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:10:35 2022] DELETE /identity/v3/projects/fb1f42bb7a1447c199926c60e648d33f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:36.163873 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:36.174228 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706843d-16b5-47f7-a463-7a8925ee6256 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:36.231273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:36.232572 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:36.233004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:36.233435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] PATH_INFO: `/v3/users/a5260e7b9f6f4aeea2e82dae5807927a` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:36.234663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5260e7b9f6f4aeea2e82dae5807927a)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:36.236602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:36.451490 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:36.457456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5260e7b9f6f4aeea2e82dae5807927a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.598340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5260e7b9f6f4aeea2e82dae5807927a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.611244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5260e7b9f6f4aeea2e82dae5807927a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.617930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5260e7b9f6f4aeea2e82dae5807927a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.618567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-dc4f177a-4405-4802-9236-9ac8300de368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5260e7b9f6f4aeea2e82dae5807927a'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:36.625235 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1355/2715] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:10:36 2022] DELETE /identity/v3/users/a5260e7b9f6f4aeea2e82dae5807927a => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:37.100108 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:37.102135 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:37.122822 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150f3ac-3453-4202-b950-17ef81a7c207 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:37.182666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:37.183526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.183832 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.184136 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] PATH_INFO: `/v3/projects/fbec0072ea2c4607b0368d4fc4db848f` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.185362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbec0072ea2c4607b0368d4fc4db848f)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:37.187306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:37.281402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbec0072ea2c4607b0368d4fc4db848f', 'request_id': 'req-4c839d88-1513-493b-9a31-ed936c17b796'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:37.287655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbec0072ea2c4607b0368d4fc4db848f', 'request_id': 'req-4c839d88-1513-493b-9a31-ed936c17b796'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:37.401460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbec0072ea2c4607b0368d4fc4db848f', 'request_id': 'req-4c839d88-1513-493b-9a31-ed936c17b796'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:37.407873 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:37.413910 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] The token cache is being invalidate because project fbec0072ea2c4607b0368d4fc4db848f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:10:37.417677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:37.417677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4c839d88-1513-493b-9a31-ed936c17b796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:10:37.417677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1361/2716] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:10:37 2022] DELETE /identity/v3/projects/fbec0072ea2c4607b0368d4fc4db848f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:37.421977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903f7d-9e58-4c28-9809-04485cc1db40 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.422484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903f7d-9e58-4c28-9809-04485cc1db40 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.422598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903f7d-9e58-4c28-9809-04485cc1db40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.440065 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-86903f7d-9e58-4c28-9809-04485cc1db40 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:37.441281 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-86903f7d-9e58-4c28-9809-04485cc1db40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:37.501826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1356/2717] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:37.509701 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa48024-ce54-439a-8134-022801018a58 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.509996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa48024-ce54-439a-8134-022801018a58 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.510281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa48024-ce54-439a-8134-022801018a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.529872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-afa48024-ce54-439a-8134-022801018a58 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:37.531063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-afa48024-ce54-439a-8134-022801018a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:37.539027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1362/2718] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:37.543248 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86903f7d-9e58-4c28-9809-04485cc1db40 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:37.553576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86903f7d-9e58-4c28-9809-04485cc1db40 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:37.558296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:37.558982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.559268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.559550 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.560274 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:10:37.560620 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:37.562251 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:37.574394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1357/2719] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:10:37.578727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa48024-ce54-439a-8134-022801018a58 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:37.587821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa48024-ce54-439a-8134-022801018a58 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:37.593334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:37.593972 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.594253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.594527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.595250 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:37.597157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:37.691272 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1363/2720] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:10:37 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:10:37.695546 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:37.706082 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fc8712-106f-4c73-8604-aa4d87a2fb16 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:37.767138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:37.767812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.768096 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.768495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.769332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:37.771294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:37.864422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1358/2721] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:10:37 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:10:37.868637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:37.879204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c876592-13b9-45d2-8763-ecf7e41be893 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:37.883897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:37.884583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.884871 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.885152 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.885919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:37.888064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:37.898525 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1364/2722] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:10:37.902406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:37.913230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135b745-9137-4d2f-804b-8349480756da admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:37.918202 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eef8a8-3e77-4d92-84c7-2d8f2146cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:37.919100 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef8a8-3e77-4d92-84c7-2d8f2146cd3f admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.919395 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef8a8-3e77-4d92-84c7-2d8f2146cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.919680 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef8a8-3e77-4d92-84c7-2d8f2146cd3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.920431 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eef8a8-3e77-4d92-84c7-2d8f2146cd3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:37.922084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eef8a8-3e77-4d92-84c7-2d8f2146cd3f admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:37.932034 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1359/2723] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:10:37.936333 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:37.946326 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc5377-bb6d-4013-a4d9-19e7c35c8ad4 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:37.951617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:37.952510 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:37.952796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:37.953077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] PATH_INFO: `/v3/projects/80a4eea3496d49ceb7e2d9efd591599b/users/e6aa89697cc746cc91575cd4acf18a98/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:37.967127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a4eea3496d49ceb7e2d9efd591599b, user_id=e6aa89697cc746cc91575cd4acf18a98, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:37.969795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:38.108212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1365/2724] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:10:37 2022] PUT /identity/v3/projects/80a4eea3496d49ceb7e2d9efd591599b/users/e6aa89697cc746cc91575cd4acf18a98/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:10:38.119840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f99426-f20c-4a3b-9d14-502abfc9d491 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:38.120138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f99426-f20c-4a3b-9d14-502abfc9d491 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:38.120462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f99426-f20c-4a3b-9d14-502abfc9d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:38.147195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-f8f99426-f20c-4a3b-9d14-502abfc9d491 None None] MFA Rules not processed for user `e6aa89697cc746cc91575cd4acf18a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:10:38.148426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f8f99426-f20c-4a3b-9d14-502abfc9d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:38.158003 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:38.213511 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1360/2725] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:10:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:10:38.225764 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:10:38.227642 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:10:38.285684 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be31f4-2e75-44c4-89ba-a21c3a84e3c3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:10:38.289295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40341a25-cf0b-4761-af90-5b67c4355665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:10:38.289935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341a25-cf0b-4761-af90-5b67c4355665 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:10:38.290220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341a25-cf0b-4761-af90-5b67c4355665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:10:38.290497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40341a25-cf0b-4761-af90-5b67c4355665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:10:38.299672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40341a25-cf0b-4761-af90-5b67c4355665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:10:38.301147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40341a25-cf0b-4761-af90-5b67c4355665 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:10:38.310301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1366/2726] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:10:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:10:48.272587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=22 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:10:48.305870 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:19.431138 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f99426-f20c-4a3b-9d14-502abfc9d491 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:19.504616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f99426-f20c-4a3b-9d14-502abfc9d491 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:19.509256 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:19.510958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:19.511242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:19.511517 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] PATH_INFO: `/v3/users/e6aa89697cc746cc91575cd4acf18a98` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:19.512732 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6aa89697cc746cc91575cd4acf18a98)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:19.514662 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:19.733776 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6aa89697cc746cc91575cd4acf18a98'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:19.823438 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6aa89697cc746cc91575cd4acf18a98'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:19.837195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6aa89697cc746cc91575cd4acf18a98'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:19.844360 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6aa89697cc746cc91575cd4acf18a98'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:19.845153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6aa89697cc746cc91575cd4acf18a98'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:19.851858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1361/2727] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:11:19 2022] DELETE /identity/v3/users/e6aa89697cc746cc91575cd4acf18a98 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:11:19.857279 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:19.857778 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:19.858057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:19.877143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:19.878469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:19.943369 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1367/2728] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:19.955322 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:19.956816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:20.014485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d29ba9-5f1e-439a-a836-967e2795210d admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:20.018118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:20.018769 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:20.019057 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:20.019340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:20.028730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:20.030178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:20.039763 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1362/2729] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:11:20.371178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:20.372640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:20.445941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c7dc2-858f-4da5-89f7-92a9b918bb2c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:20.452254 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614e36f-39e1-4606-82cd-a3260e81ecea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:20.453142 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614e36f-39e1-4606-82cd-a3260e81ecea service nova] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:20.453445 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614e36f-39e1-4606-82cd-a3260e81ecea service nova] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:20.453724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614e36f-39e1-4606-82cd-a3260e81ecea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:20.455797 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5614e36f-39e1-4606-82cd-a3260e81ecea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:20.468323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614e36f-39e1-4606-82cd-a3260e81ecea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:20.472828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614e36f-39e1-4606-82cd-a3260e81ecea service nova] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:20.484803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1368/2730] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:11:20.699076 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:20.700886 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:20.716700 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e25b60-ecde-4346-b552-5e57ce0b4051 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:20.721477 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:20.722302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:20.722587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:20.722861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] PATH_INFO: `/v3/projects/80a4eea3496d49ceb7e2d9efd591599b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:20.724056 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a4eea3496d49ceb7e2d9efd591599b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:20.726294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:20.747592 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:20.909242 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a4eea3496d49ceb7e2d9efd591599b', 'request_id': 'req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:20.915355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a4eea3496d49ceb7e2d9efd591599b', 'request_id': 'req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:21.046069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a4eea3496d49ceb7e2d9efd591599b', 'request_id': 'req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:21.058085 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] The token cache is being invalidate because project 80a4eea3496d49ceb7e2d9efd591599b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:11:21.058390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:21.059035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-550f8f47-c4da-4965-a9c3-a1a5e0e98bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:21.060619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1363/2731] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:11:20 2022] DELETE /identity/v3/projects/80a4eea3496d49ceb7e2d9efd591599b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:21.066110 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453220-2586-4463-9c29-1ae30769d93b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.066607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453220-2586-4463-9c29-1ae30769d93b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.066727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f453220-2586-4463-9c29-1ae30769d93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.085214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1f453220-2586-4463-9c29-1ae30769d93b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:21.086503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1f453220-2586-4463-9c29-1ae30769d93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:21.147707 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1369/2732] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:21.156160 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5cf3-515c-4dff-ba0a-8a30d725f936 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.156569 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5cf3-515c-4dff-ba0a-8a30d725f936 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.156921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a5cf3-515c-4dff-ba0a-8a30d725f936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.175807 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-7b4a5cf3-515c-4dff-ba0a-8a30d725f936 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:21.177118 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7b4a5cf3-515c-4dff-ba0a-8a30d725f936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:21.185054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1364/2733] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:21.189497 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f453220-2586-4463-9c29-1ae30769d93b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:21.199420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f453220-2586-4463-9c29-1ae30769d93b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:21.203979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:21.209115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.209115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.209115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.209115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:11:21.209115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:21.209115 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:21.220884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1370/2734] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:11:21.225087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a5cf3-515c-4dff-ba0a-8a30d725f936 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:21.235268 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a5cf3-515c-4dff-ba0a-8a30d725f936 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:21.239961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:21.245783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.245783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.245783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.245783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:21.245783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:21.368465 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1365/2735] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:11:21 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:11:21.372456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:21.382632 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598e7b-2e53-458a-a2a3-9cb14c60b797 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:21.394126 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:21.442021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:21.442690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.442982 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.443261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.443945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:21.445900 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:21.563165 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1371/2736] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:11:21 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:11:21.567602 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:21.578363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bd43c-6492-4611-b4ef-829fbe3733d7 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:21.582879 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:21.583536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.583824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.584106 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.584933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:21.586539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:21.597424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1366/2737] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:11:21.603469 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:21.613433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc0ac2-5d6f-432f-a3ce-8c6b6f24195e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:21.618083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf97144-8035-4892-9ad6-12e46617776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:21.618819 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97144-8035-4892-9ad6-12e46617776f admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.619061 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97144-8035-4892-9ad6-12e46617776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.619337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf97144-8035-4892-9ad6-12e46617776f admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.620057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf97144-8035-4892-9ad6-12e46617776f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:21.621725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf97144-8035-4892-9ad6-12e46617776f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:21.631850 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1372/2738] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:11:21.636743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:21.646723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ebff1-b203-4ca3-9373-d2ad3699dd9b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:21.652181 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:21.653146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.653430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.653708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] PATH_INFO: `/v3/projects/7f656bc4fcdf4e6b9656733cfbfffb8e/users/512a5e4188e34ffe9eee31cd8d4f52a7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.668423 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f656bc4fcdf4e6b9656733cfbfffb8e, user_id=512a5e4188e34ffe9eee31cd8d4f52a7, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:21.671099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:21.805720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1367/2739] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:11:21 2022] PUT /identity/v3/projects/7f656bc4fcdf4e6b9656733cfbfffb8e/users/512a5e4188e34ffe9eee31cd8d4f52a7/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:21.817877 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4302d37-7984-496b-96d6-1af4894b03be None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.818178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4302d37-7984-496b-96d6-1af4894b03be None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.818473 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4302d37-7984-496b-96d6-1af4894b03be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.845480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b4302d37-7984-496b-96d6-1af4894b03be None None] MFA Rules not processed for user `512a5e4188e34ffe9eee31cd8d4f52a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:21.846686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b4302d37-7984-496b-96d6-1af4894b03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:21.918750 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1373/2740] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:21.922894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:21.986712 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99231e66-6f9c-43cb-9b11-d2554e120d33 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:21.991422 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:21.992079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:21.992366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:21.992692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:21.993380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:21.995936 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:22.133191 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1368/2741] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:11:21 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:11:22.137583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4302d37-7984-496b-96d6-1af4894b03be None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:22.148140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4302d37-7984-496b-96d6-1af4894b03be None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:22.205004 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:22.205673 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:22.205991 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:22.206275 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:22.206971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:22.208917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:22.302872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1374/2742] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:11:22 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:11:22.308037 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:22.318649 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77483c11-c603-49c2-a62b-0c8d6e1d52ae admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:22.323750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:22.324424 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:22.324729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:22.325010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:22.325733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:22.327339 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:22.338264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1369/2743] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:11:22.342257 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:22.352449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5847cfa-a630-4b21-a4c7-7fe9f21cb157 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:22.357909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d9466-2634-42b9-881d-1fb9653b47f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:22.358603 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d9466-2634-42b9-881d-1fb9653b47f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:22.358891 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d9466-2634-42b9-881d-1fb9653b47f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:22.359186 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d9466-2634-42b9-881d-1fb9653b47f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:22.359894 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d9466-2634-42b9-881d-1fb9653b47f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:22.361541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d9466-2634-42b9-881d-1fb9653b47f6 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:22.366801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:22.372562 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1375/2744] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:11:22.376840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:22.387809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b49678d-90b0-4d8c-b415-1c4c5c54773c admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:22.392533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:22.393403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:22.393684 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:22.393957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] PATH_INFO: `/v3/projects/5c89a628cd3d450eab8b1be96d9790c5/users/4748b3f8c53040cf835d158b8c14f7cb/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:22.406844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:22.409906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c89a628cd3d450eab8b1be96d9790c5, user_id=4748b3f8c53040cf835d158b8c14f7cb, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:22.412604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:22.510757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1370/2745] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:11:22 2022] PUT /identity/v3/projects/5c89a628cd3d450eab8b1be96d9790c5/users/4748b3f8c53040cf835d158b8c14f7cb/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:22.519803 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325972-0484-4e19-9887-9708b528ac9e None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:22.520158 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325972-0484-4e19-9887-9708b528ac9e None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:22.520488 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf325972-0484-4e19-9887-9708b528ac9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:22.547923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-bf325972-0484-4e19-9887-9708b528ac9e None None] MFA Rules not processed for user `4748b3f8c53040cf835d158b8c14f7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:22.556844 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-bf325972-0484-4e19-9887-9708b528ac9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:22.612827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1376/2746] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:22.617515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:22.680503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f79ef6-821d-4032-bec4-76bbc7df6438 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:22.688655 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:22.689575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:22.689860 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:22.690141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:22.690839 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:22.692832 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:22.844374 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1371/2747] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:11:22 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:11:22.848682 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325972-0484-4e19-9887-9708b528ac9e None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:22.860213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf325972-0484-4e19-9887-9708b528ac9e None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:22.916911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:22.917507 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:22.917798 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:22.918083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:22.918775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:22.920771 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:23.043953 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1377/2748] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:11:22 2022] POST /identity/v3/users => generated 298 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:11:23.048081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:23.058787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5474987-8ee0-47d2-b782-fe6a76151ca5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:23.063388 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:23.064307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:23.064619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:23.064898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:23.065618 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:23.067207 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:23.078615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1372/2749] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:11:23.082806 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:23.092734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7ab02-fabd-476d-8b7f-efabc47e39d9 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:23.097274 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:23.098141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:23.098429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:23.098703 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] PATH_INFO: `/v3/projects/14d10ddab81f416aa7f23b3b65c2c617/users/43be798b57ff496e9160edfed07c9d3e/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:23.113512 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d10ddab81f416aa7f23b3b65c2c617, user_id=43be798b57ff496e9160edfed07c9d3e, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:23.116209 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:23.240485 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1378/2750] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:11:23 2022] PUT /identity/v3/projects/14d10ddab81f416aa7f23b3b65c2c617/users/43be798b57ff496e9160edfed07c9d3e/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:23.244559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:23.254730 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e236fed-488f-41ae-8370-d534e35ad1a7 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:23.313651 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0b345-4b64-419d-8681-154d8a3676c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:23.314568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b345-4b64-419d-8681-154d8a3676c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:23.314854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b345-4b64-419d-8681-154d8a3676c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:23.315136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0b345-4b64-419d-8681-154d8a3676c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:23.315859 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b345-4b64-419d-8681-154d8a3676c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:23.317628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0b345-4b64-419d-8681-154d8a3676c5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:23.327508 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1373/2751] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:11:23.331691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:23.343039 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7a4b-7645-423f-81eb-b37509b38819 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:23.347644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:23.348622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:23.348909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:23.349184 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] PATH_INFO: `/v3/projects/14d10ddab81f416aa7f23b3b65c2c617/users/43be798b57ff496e9160edfed07c9d3e/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:23.351150 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14d10ddab81f416aa7f23b3b65c2c617, user_id=43be798b57ff496e9160edfed07c9d3e, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:23.354508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:23.364637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1379/2752] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:11:23 2022] PUT /identity/v3/projects/14d10ddab81f416aa7f23b3b65c2c617/users/43be798b57ff496e9160edfed07c9d3e/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:11:23.375990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4050a-0a0a-4d01-9b6c-00f45d018d1b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:23.376282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4050a-0a0a-4d01-9b6c-00f45d018d1b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:23.376605 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b4050a-0a0a-4d01-9b6c-00f45d018d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:23.403527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d8b4050a-0a0a-4d01-9b6c-00f45d018d1b None None] MFA Rules not processed for user `43be798b57ff496e9160edfed07c9d3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:23.404783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d8b4050a-0a0a-4d01-9b6c-00f45d018d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:23.453351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:23.473983 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1374/2753] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:23.486154 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:23.487840 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:23.535696 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:23.549304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d17116-34e3-4c43-b51b-a941d6ccd7d2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:23.553008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:23.553710 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:23.553997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:23.554282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:23.611568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:23.613316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:23.622212 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1380/2754] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:11:26.652585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4050a-0a0a-4d01-9b6c-00f45d018d1b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:26.662178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b4050a-0a0a-4d01-9b6c-00f45d018d1b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:26.666357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:26.667017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:26.667308 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:26.667590 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:26.727615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:26.729596 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:26.738468 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1375/2755] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:11:28.771379 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:28.780989 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b0640-32bf-4d21-a66b-e85d488219e0 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:28.784795 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b92699-d0be-463d-96f3-48d4fe3e45c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:28.785425 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92699-d0be-463d-96f3-48d4fe3e45c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:28.785709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92699-d0be-463d-96f3-48d4fe3e45c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:28.785987 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b92699-d0be-463d-96f3-48d4fe3e45c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:28.794881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b92699-d0be-463d-96f3-48d4fe3e45c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:28.796282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b92699-d0be-463d-96f3-48d4fe3e45c9 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:28.805463 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1381/2756] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:11:35.610051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:35.674476 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf645ea0-a8c0-49d3-a80a-df46bab43439 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:35.679035 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:35.679898 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:35.680186 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:35.680503 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] PATH_INFO: `/v3/users/512a5e4188e34ffe9eee31cd8d4f52a7` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:35.681689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=512a5e4188e34ffe9eee31cd8d4f52a7)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:35.684239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:35.936536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512a5e4188e34ffe9eee31cd8d4f52a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.002393 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512a5e4188e34ffe9eee31cd8d4f52a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.016570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512a5e4188e34ffe9eee31cd8d4f52a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.024597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512a5e4188e34ffe9eee31cd8d4f52a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.025426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512a5e4188e34ffe9eee31cd8d4f52a7'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.032115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1376/2757] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:11:35 2022] DELETE /identity/v3/users/512a5e4188e34ffe9eee31cd8d4f52a7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:36.036646 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:36.037112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:36.037219 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:36.055301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:36.056549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:36.118156 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1382/2758] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:36.130750 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:36.132273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:36.139408 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:36.190875 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81438c-6b3b-401c-bf04-e201c6f7c6d7 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:36.194520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:36.195162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:36.195447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:36.195726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:36.205740 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:36.208951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:36.216870 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1377/2759] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:11:36.652263 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:36.653708 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:36.666314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b446e9-6482-4a42-93e3-d354b0f1d9e9 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:36.672147 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:36.673151 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:36.673511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:36.673788 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] PATH_INFO: `/v3/projects/7f656bc4fcdf4e6b9656733cfbfffb8e` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:36.674971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f656bc4fcdf4e6b9656733cfbfffb8e)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:36.677175 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:36.788928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f656bc4fcdf4e6b9656733cfbfffb8e', 'request_id': 'req-386894f1-4af3-47f2-95c8-91cbb84080b4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.794979 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f656bc4fcdf4e6b9656733cfbfffb8e', 'request_id': 'req-386894f1-4af3-47f2-95c8-91cbb84080b4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.864763 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f656bc4fcdf4e6b9656733cfbfffb8e', 'request_id': 'req-386894f1-4af3-47f2-95c8-91cbb84080b4'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.875432 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] The token cache is being invalidate because project 7f656bc4fcdf4e6b9656733cfbfffb8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:11:36.875724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.876353 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:36.877922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1383/2760] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:11:36 2022] DELETE /identity/v3/projects/7f656bc4fcdf4e6b9656733cfbfffb8e => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:36.881908 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:36.892376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022960ed-d640-438e-b970-fa6ac7aafdf9 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:36.947642 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:36.948539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:36.948829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:36.949116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] PATH_INFO: `/v3/users/4748b3f8c53040cf835d158b8c14f7cb` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:36.950332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4748b3f8c53040cf835d158b8c14f7cb)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:36.952844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:37.185378 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4748b3f8c53040cf835d158b8c14f7cb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:37.256710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4748b3f8c53040cf835d158b8c14f7cb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:37.268800 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4748b3f8c53040cf835d158b8c14f7cb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:37.275589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4748b3f8c53040cf835d158b8c14f7cb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:37.276244 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4748b3f8c53040cf835d158b8c14f7cb'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:37.282715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1378/2761] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:11:36 2022] DELETE /identity/v3/users/4748b3f8c53040cf835d158b8c14f7cb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:37.698329 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:37.699831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:37.713886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386894f1-4af3-47f2-95c8-91cbb84080b4 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:37.718382 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:37.771823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:37.772721 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:37.773012 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:37.773301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] PATH_INFO: `/v3/projects/5c89a628cd3d450eab8b1be96d9790c5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:37.774479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c89a628cd3d450eab8b1be96d9790c5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:37.776447 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:37.903345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c89a628cd3d450eab8b1be96d9790c5', 'request_id': 'req-8b063314-478f-4d6c-8102-d1a8bbf4b087'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:37.910796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c89a628cd3d450eab8b1be96d9790c5', 'request_id': 'req-8b063314-478f-4d6c-8102-d1a8bbf4b087'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:37.990613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c89a628cd3d450eab8b1be96d9790c5', 'request_id': 'req-8b063314-478f-4d6c-8102-d1a8bbf4b087'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.001287 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] The token cache is being invalidate because project 5c89a628cd3d450eab8b1be96d9790c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:11:38.001575 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.002213 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.003739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1384/2762] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:11:37 2022] DELETE /identity/v3/projects/5c89a628cd3d450eab8b1be96d9790c5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:38.013544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:38.013544 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:38.022716 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be078-c362-4868-8df6-ddfc2fbc3b62 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:38.048356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:38.082622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:38.084335 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:38.084645 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:38.084921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] PATH_INFO: `/v3/users/43be798b57ff496e9160edfed07c9d3e` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:38.086203 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=43be798b57ff496e9160edfed07c9d3e)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:38.088386 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:38.298669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43be798b57ff496e9160edfed07c9d3e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.385164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43be798b57ff496e9160edfed07c9d3e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.398043 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43be798b57ff496e9160edfed07c9d3e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.404792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43be798b57ff496e9160edfed07c9d3e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.405512 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43be798b57ff496e9160edfed07c9d3e'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:38.411369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1379/2763] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:11:38 2022] DELETE /identity/v3/users/43be798b57ff496e9160edfed07c9d3e => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:38.835916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:38.837714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:38.853198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b063314-478f-4d6c-8102-d1a8bbf4b087 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:38.923044 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:38.923911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:38.924203 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:38.924521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] PATH_INFO: `/v3/projects/14d10ddab81f416aa7f23b3b65c2c617` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:38.925717 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=14d10ddab81f416aa7f23b3b65c2c617)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:38.927609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:39.039236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:39.046260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14d10ddab81f416aa7f23b3b65c2c617', 'request_id': 'req-6f237e24-6481-40d2-a838-aeb295a433bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:39.052356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14d10ddab81f416aa7f23b3b65c2c617', 'request_id': 'req-6f237e24-6481-40d2-a838-aeb295a433bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:39.137060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14d10ddab81f416aa7f23b3b65c2c617', 'request_id': 'req-6f237e24-6481-40d2-a838-aeb295a433bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:39.148604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] The token cache is being invalidate because project 14d10ddab81f416aa7f23b3b65c2c617 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:11:39.148897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:39.149517 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:39.151067 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1385/2764] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:11:38 2022] DELETE /identity/v3/projects/14d10ddab81f416aa7f23b3b65c2c617 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:48.407949 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:49.217161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:56.124006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:56.124006 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:56.138172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d71db-cdf4-45bd-9a8c-959286e7b6ea admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:56.214114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:56.215015 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:56.215306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:56.215606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] PATH_INFO: `/v3/users/36ce0ba640c045118116e1b68c4f3e63` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:56.216861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ce0ba640c045118116e1b68c4f3e63)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:56.218827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:56.458521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ce0ba640c045118116e1b68c4f3e63'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:56.570688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ce0ba640c045118116e1b68c4f3e63'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:56.583617 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ce0ba640c045118116e1b68c4f3e63'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:56.590494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ce0ba640c045118116e1b68c4f3e63'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:56.591164 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-df651de6-e949-4c98-9efd-115eedba9e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ce0ba640c045118116e1b68c4f3e63'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:56.597165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1380/2765] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:11:56 2022] DELETE /identity/v3/users/36ce0ba640c045118116e1b68c4f3e63 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:56.846637 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:56.849030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:56.870082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f237e24-6481-40d2-a838-aeb295a433bf admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:56.927879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:56.928766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:56.929051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:56.929346 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] PATH_INFO: `/v3/projects/48bc1d636aba41d1a3534c56e3a4ccda` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:56.930523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48bc1d636aba41d1a3534c56e3a4ccda)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:56.932464 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.061951 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48bc1d636aba41d1a3534c56e3a4ccda', 'request_id': 'req-08158a07-363f-4ae2-a78a-7e61e1f36f43'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:57.068381 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48bc1d636aba41d1a3534c56e3a4ccda', 'request_id': 'req-08158a07-363f-4ae2-a78a-7e61e1f36f43'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:57.147687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48bc1d636aba41d1a3534c56e3a4ccda', 'request_id': 'req-08158a07-363f-4ae2-a78a-7e61e1f36f43'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:57.158741 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] The token cache is being invalidate because project 48bc1d636aba41d1a3534c56e3a4ccda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:11:57.159076 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:57.159841 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-08158a07-363f-4ae2-a78a-7e61e1f36f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:11:57.162052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1386/2766] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:11:56 2022] DELETE /identity/v3/projects/48bc1d636aba41d1a3534c56e3a4ccda => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:57.168048 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216507ae-6196-4f13-bbd4-dc9db79e1af4 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.172313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216507ae-6196-4f13-bbd4-dc9db79e1af4 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.172313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216507ae-6196-4f13-bbd4-dc9db79e1af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.188462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-216507ae-6196-4f13-bbd4-dc9db79e1af4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:57.189708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-216507ae-6196-4f13-bbd4-dc9db79e1af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:57.248667 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1381/2767] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:57.256874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b4c9-c38b-4c37-823e-e3631164501c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.257172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b4c9-c38b-4c37-823e-e3631164501c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.257456 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b4c9-c38b-4c37-823e-e3631164501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.275879 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9276b4c9-c38b-4c37-823e-e3631164501c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:57.277121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9276b4c9-c38b-4c37-823e-e3631164501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:57.285037 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1387/2768] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:57.289747 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216507ae-6196-4f13-bbd4-dc9db79e1af4 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.299302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216507ae-6196-4f13-bbd4-dc9db79e1af4 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.304147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.304827 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.305113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.305391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.306110 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:11:57.306418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.308025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.319604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1382/2769] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:11:57.323611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b4c9-c38b-4c37-823e-e3631164501c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.333236 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b4c9-c38b-4c37-823e-e3631164501c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.338116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.338757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.339046 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.339323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.340010 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.341947 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.449393 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1388/2770] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:11:57 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:11:57.453647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.464586 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de502b2-b1d9-4f61-84af-5a45368e3efc admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.468344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:57.524639 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.525312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.525603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.525885 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.526629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.529455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.601878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1383/2771] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:11:57 2022] POST /identity/v3/users => generated 296 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:11:57.605983 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.616124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ad5112-e7d3-447a-acb5-b92cec640fdc admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.620992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.621654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.621944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.622227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.622962 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.624588 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.635849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1389/2772] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:11:57.639704 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.650376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d31859-9f16-4aa1-a7a4-70131574c9f5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.655143 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4fd02-42b5-48ba-ad7c-cd501c60615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.655789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4fd02-42b5-48ba-ad7c-cd501c60615a admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.656079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4fd02-42b5-48ba-ad7c-cd501c60615a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.656361 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4fd02-42b5-48ba-ad7c-cd501c60615a admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.657117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4fd02-42b5-48ba-ad7c-cd501c60615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.658715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4fd02-42b5-48ba-ad7c-cd501c60615a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.668643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1384/2773] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:11:57.672540 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.682574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5026f-765a-4710-a617-ec64529221c3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.687427 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.688645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.688930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.689230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] PATH_INFO: `/v3/projects/4203d20f58224989a1b22f8c73f52c9c/users/14be006958824e8fbf0f6aa2fcc44850/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.704185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4203d20f58224989a1b22f8c73f52c9c, user_id=14be006958824e8fbf0f6aa2fcc44850, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.706862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.782008 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1390/2774] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:11:57 2022] PUT /identity/v3/projects/4203d20f58224989a1b22f8c73f52c9c/users/14be006958824e8fbf0f6aa2fcc44850/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:11:57.792059 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.792357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.792673 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.820205 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] MFA Rules not processed for user `14be006958824e8fbf0f6aa2fcc44850`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:11:57.821450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:57.884151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1385/2775] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:11:57.894687 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:11:57.896478 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:11:57.927210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:11:57.953240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e96417-bb01-4866-8128-872cf928145f admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:11:57.956950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:11:57.957624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:11:57.957909 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:11:57.958360 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:11:57.966570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:11:57.968371 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:11:57.977711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1391/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:11:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:05.549084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:05.550549 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:05.626049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536ba6b-7b6a-46de-b741-a1c7b58ed4fd None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:05.631091 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bb833-33ca-4c7b-8f09-69d2598a3718 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:05.631738 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bb833-33ca-4c7b-8f09-69d2598a3718 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:05.632025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bb833-33ca-4c7b-8f09-69d2598a3718 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:05.632304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bb833-33ca-4c7b-8f09-69d2598a3718 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:05.634115 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-960bb833-33ca-4c7b-8f09-69d2598a3718 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:05.645754 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bb833-33ca-4c7b-8f09-69d2598a3718 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:05.647338 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bb833-33ca-4c7b-8f09-69d2598a3718 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:05.657194 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1386/2777] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:08.036107 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=14 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:15.652917 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:23.513955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:23.594180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a35d3-de23-4ab5-841e-8a2ea3c83e27 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:23.599417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:23.600296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.600627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.600902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] PATH_INFO: `/v3/users/14be006958824e8fbf0f6aa2fcc44850` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.602085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14be006958824e8fbf0f6aa2fcc44850)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:23.604080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:23.795103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14be006958824e8fbf0f6aa2fcc44850'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:23.878568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14be006958824e8fbf0f6aa2fcc44850'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:23.891640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14be006958824e8fbf0f6aa2fcc44850'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:23.898622 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14be006958824e8fbf0f6aa2fcc44850'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:23.899319 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14be006958824e8fbf0f6aa2fcc44850'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:23.905341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1392/2778] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:12:23 2022] DELETE /identity/v3/users/14be006958824e8fbf0f6aa2fcc44850 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:23.909791 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:23.911022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:23.911425 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:23.929980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:12:23.931231 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:23.990634 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1387/2779] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:12:24.000221 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:24.001644 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:24.060027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2b475-829e-4007-9f4b-8686273f2b29 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:24.064019 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:24.064683 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:24.064965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:24.065241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:24.074294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:24.075711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:24.085606 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1393/2780] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:24.497260 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:24.498803 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:24.511835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e23cf4-e01d-41b0-97b7-dece54099064 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:24.516584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:24.520829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:24.520829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:24.520829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] PATH_INFO: `/v3/projects/4203d20f58224989a1b22f8c73f52c9c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:24.520829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=4203d20f58224989a1b22f8c73f52c9c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:24.521691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:24.642214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4203d20f58224989a1b22f8c73f52c9c', 'request_id': 'req-ef66ae85-8b8d-4467-9723-2dfee26073ba'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:24.649403 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4203d20f58224989a1b22f8c73f52c9c', 'request_id': 'req-ef66ae85-8b8d-4467-9723-2dfee26073ba'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:24.721302 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4203d20f58224989a1b22f8c73f52c9c', 'request_id': 'req-ef66ae85-8b8d-4467-9723-2dfee26073ba'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:24.732648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] The token cache is being invalidate because project 4203d20f58224989a1b22f8c73f52c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:12:24.732938 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:24.733560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:12:24.735175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1388/2781] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:12:24 2022] DELETE /identity/v3/projects/4203d20f58224989a1b22f8c73f52c9c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:12:32.079128 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:32.080595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:32.106929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:32.137607 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f397f7b-802b-433d-aba2-2269ff20fc65 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:32.186692 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:32.187338 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:32.187886 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:32.188168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:32.190006 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:32.271123 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:32.272508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:32.281448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1394/2782] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:12:34.729539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:42.277245 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=67 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:12:58.920183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:12:58.921648 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:58.978789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66ae85-8b8d-4467-9723-2dfee26073ba admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:12:58.982412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:12:58.983054 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:12:58.983341 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:12:58.983622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:12:58.985418 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:12:59.046991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:12:59.048448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:12:59.058697 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1389/2783] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:02.454620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:02.456314 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:02.471091 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad74a3b-f417-40ca-ae12-3cf5eb221453 service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:02.476715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:02.477667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:02.477968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:02.478233 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] PATH_INFO: `/v3/users/36e78feea3104797a5e927c8ffb76d18` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:02.479504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e78feea3104797a5e927c8ffb76d18)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:02.481655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:02.703563 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e78feea3104797a5e927c8ffb76d18'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:02.786851 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e78feea3104797a5e927c8ffb76d18'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:02.799617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e78feea3104797a5e927c8ffb76d18'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:02.807161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e78feea3104797a5e927c8ffb76d18'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:02.807833 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-882797b4-26b7-4f2c-b903-9589e088a61e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e78feea3104797a5e927c8ffb76d18'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:02.814042 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1395/2784] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:02 2022] DELETE /identity/v3/users/36e78feea3104797a5e927c8ffb76d18 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:03.073610 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:03.085460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e26386-86f1-4398-9258-834a1d011bba service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:03.142997 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:03.144273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.144273 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.144520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] PATH_INFO: `/v3/projects/fbb232ab0a2347dea2fa82e1cdbf24b5` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.146347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb232ab0a2347dea2fa82e1cdbf24b5)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:03.148455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:03.275968 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'request_id': 'req-269cfe67-2b00-40b7-84b0-9880d8739a39'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:03.278259 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:03.283008 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'request_id': 'req-269cfe67-2b00-40b7-84b0-9880d8739a39'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:03.359720 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb232ab0a2347dea2fa82e1cdbf24b5', 'request_id': 'req-269cfe67-2b00-40b7-84b0-9880d8739a39'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:03.370369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] The token cache is being invalidate because project fbb232ab0a2347dea2fa82e1cdbf24b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:03.370659 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:03.371296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-269cfe67-2b00-40b7-84b0-9880d8739a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:03.372888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1390/2785] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:03 2022] DELETE /identity/v3/projects/fbb232ab0a2347dea2fa82e1cdbf24b5 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:03.377793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee92a-7a3f-4f7d-b2a1-aa20b5f916ed None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.378073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee92a-7a3f-4f7d-b2a1-aa20b5f916ed None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.378358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ee92a-7a3f-4f7d-b2a1-aa20b5f916ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.397573 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-030ee92a-7a3f-4f7d-b2a1-aa20b5f916ed None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:03.398828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-030ee92a-7a3f-4f7d-b2a1-aa20b5f916ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:03.457920 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1396/2786] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:03.465389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773afed3-ac78-4628-bdaa-3edaa1a4c545 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.465682 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773afed3-ac78-4628-bdaa-3edaa1a4c545 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.465969 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773afed3-ac78-4628-bdaa-3edaa1a4c545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.484183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-773afed3-ac78-4628-bdaa-3edaa1a4c545 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:03.485444 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-773afed3-ac78-4628-bdaa-3edaa1a4c545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:03.493690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1391/2787] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:03.498070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ee92a-7a3f-4f7d-b2a1-aa20b5f916ed None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:03.508973 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ee92a-7a3f-4f7d-b2a1-aa20b5f916ed None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:03.513522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:03.514168 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.514452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.514727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.515475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:13:03.515777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:03.517389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:03.529770 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1397/2788] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:13:03.534040 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773afed3-ac78-4628-bdaa-3edaa1a4c545 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:03.543597 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773afed3-ac78-4628-bdaa-3edaa1a4c545 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:03.548269 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:03.548941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.549227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.549521 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.550171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:03.552101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:03.684844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1392/2789] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:03 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:13:03.689366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:03.700322 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda7918-cd9a-496f-bacf-575a4e9a6388 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:03.759768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:03.760904 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.761198 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.761479 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.762180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:03.764965 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:03.772754 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:03.891593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1398/2790] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:03 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:03.896094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:03.906450 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf00a-3080-4f77-bfc4-e694d52b108e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:03.912926 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:03.913951 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.914363 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.914690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.915484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:03.917232 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:03.927854 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1393/2791] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:03.931849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:03.942941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a064-06bd-4bcc-9006-64ded7c7cdde admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:03.947663 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72505aba-7867-4de0-b400-ea5abd374380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:03.948310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505aba-7867-4de0-b400-ea5abd374380 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.948625 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505aba-7867-4de0-b400-ea5abd374380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.948902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72505aba-7867-4de0-b400-ea5abd374380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.949624 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72505aba-7867-4de0-b400-ea5abd374380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:03.951214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72505aba-7867-4de0-b400-ea5abd374380 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:03.961655 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1399/2792] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:13:03.965935 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:03.976199 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa601580-322b-4d6f-ab49-b48178b76443 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:03.980857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:03.981806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:03.982094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:03.982369 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] PATH_INFO: `/v3/projects/5a5815cb07604da49ba577304f08f5bc/users/9e0d58651f94465d856d180263884dec/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:03.997466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a5815cb07604da49ba577304f08f5bc, user_id=9e0d58651f94465d856d180263884dec, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:04.000125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:04.069757 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1394/2793] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:03 2022] PUT /identity/v3/projects/5a5815cb07604da49ba577304f08f5bc/users/9e0d58651f94465d856d180263884dec/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:04.079736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d26df-58cd-4f5e-8ce8-ee20478c38df None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:04.080029 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d26df-58cd-4f5e-8ce8-ee20478c38df None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:04.080308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d26df-58cd-4f5e-8ce8-ee20478c38df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:04.107183 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-aa5d26df-58cd-4f5e-8ce8-ee20478c38df None None] MFA Rules not processed for user `9e0d58651f94465d856d180263884dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:04.108434 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-aa5d26df-58cd-4f5e-8ce8-ee20478c38df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:04.170286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1400/2794] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:04.181587 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:04.183334 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:04.257665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a66094-7677-4c63-9c4f-f8cee83070fd admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:04.263412 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7965d9d-e548-45cc-bdcf-2dd9e715e840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b73296e3c73644f29eb0b4960a747c38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:04.264093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965d9d-e548-45cc-bdcf-2dd9e715e840 service nova] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:04.264383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965d9d-e548-45cc-bdcf-2dd9e715e840 service nova] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:04.264699 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7965d9d-e548-45cc-bdcf-2dd9e715e840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:04.272497 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965d9d-e548-45cc-bdcf-2dd9e715e840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:04.274146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7965d9d-e548-45cc-bdcf-2dd9e715e840 service nova] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:04.283012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1395/2795] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:14.167452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:14.278962 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=70,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:15.622961 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d26df-58cd-4f5e-8ce8-ee20478c38df None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:15.681958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d26df-58cd-4f5e-8ce8-ee20478c38df None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:15.686415 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:15.687526 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:15.687807 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:15.688078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] PATH_INFO: `/v3/users/9e0d58651f94465d856d180263884dec` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:15.689285 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0d58651f94465d856d180263884dec)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:15.691200 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:15.908554 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0d58651f94465d856d180263884dec'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:15.993992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0d58651f94465d856d180263884dec'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.006911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0d58651f94465d856d180263884dec'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.013911 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0d58651f94465d856d180263884dec'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.014668 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0d58651f94465d856d180263884dec'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.020766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1401/2796] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:15 2022] DELETE /identity/v3/users/9e0d58651f94465d856d180263884dec => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:16.025629 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:16.029355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:16.029355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:16.043533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:16.044764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:16.103154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1396/2797] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:16.112774 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:16.114180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:16.184938 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefde2a-fd92-42dc-8515-3f45059bfcb8 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:16.188757 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f99956-6450-4f1e-af0f-fbecca0e9a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:16.189402 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99956-6450-4f1e-af0f-fbecca0e9a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:16.189697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99956-6450-4f1e-af0f-fbecca0e9a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:16.189981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f99956-6450-4f1e-af0f-fbecca0e9a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:16.199121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f99956-6450-4f1e-af0f-fbecca0e9a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:16.200595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f99956-6450-4f1e-af0f-fbecca0e9a2a service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:16.210116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1402/2798] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:16.672880 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:16.674293 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:16.688042 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c9217-b547-454d-a38b-93c97faf3659 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:16.692638 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:16.693515 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:16.694442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:16.694848 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] PATH_INFO: `/v3/projects/5a5815cb07604da49ba577304f08f5bc` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:16.696122 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a5815cb07604da49ba577304f08f5bc)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:16.698197 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:16.835492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a5815cb07604da49ba577304f08f5bc', 'request_id': 'req-24f72773-e0df-4f65-8cb9-ee3239f79057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.841847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a5815cb07604da49ba577304f08f5bc', 'request_id': 'req-24f72773-e0df-4f65-8cb9-ee3239f79057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.957371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a5815cb07604da49ba577304f08f5bc', 'request_id': 'req-24f72773-e0df-4f65-8cb9-ee3239f79057'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.968694 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] The token cache is being invalidate because project 5a5815cb07604da49ba577304f08f5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:16.968980 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.969652 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-24f72773-e0df-4f65-8cb9-ee3239f79057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:16.971175 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1397/2799] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:16 2022] DELETE /identity/v3/projects/5a5815cb07604da49ba577304f08f5bc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:16.976139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce97ea9-14f9-4a11-9437-7ff89b415373 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:16.976680 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce97ea9-14f9-4a11-9437-7ff89b415373 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:16.976823 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce97ea9-14f9-4a11-9437-7ff89b415373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:16.994060 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-1ce97ea9-14f9-4a11-9437-7ff89b415373 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:16.995241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-1ce97ea9-14f9-4a11-9437-7ff89b415373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:17.012369 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:17.053441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1403/2800] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:17.062977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75697f-5420-4f81-8389-978123479512 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.062977 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75697f-5420-4f81-8389-978123479512 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.063607 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75697f-5420-4f81-8389-978123479512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.081943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-bf75697f-5420-4f81-8389-978123479512 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:17.083146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-bf75697f-5420-4f81-8389-978123479512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:17.091718 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1398/2801] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:17.096096 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce97ea9-14f9-4a11-9437-7ff89b415373 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.106410 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce97ea9-14f9-4a11-9437-7ff89b415373 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.111071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:17.111716 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.112729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.112729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.112996 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80597) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:13:17.113305 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:17.114890 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:17.127518 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1404/2802] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:13:17.132359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75697f-5420-4f81-8389-978123479512 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.141560 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75697f-5420-4f81-8389-978123479512 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.146162 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:17.147498 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.147795 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.148073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.148974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:17.154532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:17.235390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1399/2803] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:17 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:17.239492 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.250074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2932835-8376-45dd-b143-e26e0879ed6c admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.305593 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:17.306260 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.306552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.306862 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.307550 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:17.309511 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:17.405421 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1405/2804] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:17 2022] POST /identity/v3/users => generated 295 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:17.409456 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.420366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b9390-c8b7-4aa1-9529-49847510ce65 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.424952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:17.425603 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.425889 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.426171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.426894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:17.429446 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:17.440109 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1400/2805] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:17.444740 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.454893 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30432310-0bc8-462c-965d-48ec0d6f2774 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.459691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d66405-daba-4204-b38a-ab627606b4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:17.460347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d66405-daba-4204-b38a-ab627606b4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.460670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d66405-daba-4204-b38a-ab627606b4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.460958 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d66405-daba-4204-b38a-ab627606b4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.461769 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d66405-daba-4204-b38a-ab627606b4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:17.463357 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d66405-daba-4204-b38a-ab627606b4ba admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:17.473641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1406/2806] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:17.477420 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.487510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ee11a-c674-4635-b7e2-5519188fd634 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.492863 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:17.493775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.494070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.494351 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] PATH_INFO: `/v3/projects/f468fa471a374d799fbd5a54e239ed59/users/9ebd75794a7d448ab2f088f2b9bbcbdf/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.510494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f468fa471a374d799fbd5a54e239ed59, user_id=9ebd75794a7d448ab2f088f2b9bbcbdf, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:17.513234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:17.648646 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1401/2807] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:17 2022] PUT /identity/v3/projects/f468fa471a374d799fbd5a54e239ed59/users/9ebd75794a7d448ab2f088f2b9bbcbdf/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:17.658905 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b140-554e-455f-b875-bbc689da64d6 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.659206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b140-554e-455f-b875-bbc689da64d6 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.659494 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09b140-554e-455f-b875-bbc689da64d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.687691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-4c09b140-554e-455f-b875-bbc689da64d6 None None] MFA Rules not processed for user `9ebd75794a7d448ab2f088f2b9bbcbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:17.688933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4c09b140-554e-455f-b875-bbc689da64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:17.752073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1407/2808] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:17.756739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.777282 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:17.830176 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0533392-0bb8-471b-b1c5-a904ac219d54 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.835089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:17.837429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:17.837429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:17.837429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:17.837429 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:17.839148 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:17.958464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1402/2809] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:17 2022] POST /identity/v3/projects => generated 389 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:13:17.963064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b140-554e-455f-b875-bbc689da64d6 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:17.973653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09b140-554e-455f-b875-bbc689da64d6 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:17.986535 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:18.030224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:18.030815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.031105 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.031389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] PATH_INFO: `/v3/users` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.032073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:18.034031 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:18.146394 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1408/2810] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:17 2022] POST /identity/v3/users => generated 301 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:18.150891 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:18.161209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32910-4aa2-497b-9c4c-92d88a316fb2 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:18.166604 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:18.167261 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.167548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.167829 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.168599 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:18.170264 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:18.180852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1403/2811] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:18.184755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:18.195074 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ede96-cbfe-4587-9343-f858a1b2e4cc admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:18.199779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:18.200693 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.200986 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.202211 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] PATH_INFO: `/v3/projects/dfe46479b78d4a5bab8ab27f65238a10/users/0729b4c76df543d7907817c3498a2913/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.216899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe46479b78d4a5bab8ab27f65238a10, user_id=0729b4c76df543d7907817c3498a2913, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:18.219608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:18.308686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1409/2812] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:18 2022] PUT /identity/v3/projects/dfe46479b78d4a5bab8ab27f65238a10/users/0729b4c76df543d7907817c3498a2913/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:18.313049 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:18.323844 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf836928-1cc2-4931-a630-076daf3ac52e admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:18.379488 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285997bd-46d0-472e-822e-c09f6d7ec7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:18.380146 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285997bd-46d0-472e-822e-c09f6d7ec7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.380455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285997bd-46d0-472e-822e-c09f6d7ec7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.380741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285997bd-46d0-472e-822e-c09f6d7ec7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.382007 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285997bd-46d0-472e-822e-c09f6d7ec7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:18.383678 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285997bd-46d0-472e-822e-c09f6d7ec7e1 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:18.393474 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1404/2813] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:18.397702 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:18.408821 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14115-0ed4-4dbf-83de-183fa38dd17b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:18.413572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:18.414475 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.414766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.415049 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] PATH_INFO: `/v3/projects/dfe46479b78d4a5bab8ab27f65238a10/users/0729b4c76df543d7907817c3498a2913/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.417062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe46479b78d4a5bab8ab27f65238a10, user_id=0729b4c76df543d7907817c3498a2913, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:18.420085 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:18.430301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1410/2814] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:18 2022] PUT /identity/v3/projects/dfe46479b78d4a5bab8ab27f65238a10/users/0729b4c76df543d7907817c3498a2913/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:18.440475 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9176-bba9-44fb-aae5-61a91318f82d None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.440778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9176-bba9-44fb-aae5-61a91318f82d None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.441063 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f9176-bba9-44fb-aae5-61a91318f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.602821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d34f9176-bba9-44fb-aae5-61a91318f82d None None] MFA Rules not processed for user `0729b4c76df543d7907817c3498a2913`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:18.603973 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d34f9176-bba9-44fb-aae5-61a91318f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:18.669023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1405/2815] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:18.680240 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:18.681966 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:18.739153 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11192-b62f-4524-85dc-b39bc6f89309 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:18.744058 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c17af-3561-4849-b69b-66ce2aed7df2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:18.744773 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c17af-3561-4849-b69b-66ce2aed7df2 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.745089 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c17af-3561-4849-b69b-66ce2aed7df2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.745372 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c17af-3561-4849-b69b-66ce2aed7df2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.754810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c17af-3561-4849-b69b-66ce2aed7df2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:18.756615 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c17af-3561-4849-b69b-66ce2aed7df2 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:18.766564 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1411/2816] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:18.895485 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9176-bba9-44fb-aae5-61a91318f82d None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:18.913406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:18.958389 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f9176-bba9-44fb-aae5-61a91318f82d None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:18.963332 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:18.964183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:18.964496 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:18.964778 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] PATH_INFO: `/v3/users/9ebd75794a7d448ab2f088f2b9bbcbdf` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:18.965952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebd75794a7d448ab2f088f2b9bbcbdf)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:18.967895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:19.148688 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebd75794a7d448ab2f088f2b9bbcbdf'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:19.222180 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebd75794a7d448ab2f088f2b9bbcbdf'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:19.237469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebd75794a7d448ab2f088f2b9bbcbdf'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:19.245991 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebd75794a7d448ab2f088f2b9bbcbdf'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:19.246724 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebd75794a7d448ab2f088f2b9bbcbdf'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:19.253050 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1406/2817] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:18 2022] DELETE /identity/v3/users/9ebd75794a7d448ab2f088f2b9bbcbdf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:19.258677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:19.259241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:19.259241 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:19.277127 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:19.278330 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:19.338546 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1412/2818] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:13:19.349158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:19.351137 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:19.414957 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f57fc6-803b-4dd5-bf86-4c45342be2ce admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:19.418495 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:19.419141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:19.419421 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:19.419692 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:19.431789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:19.433397 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:19.445731 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1407/2819] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:19.943548 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:19.945016 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:19.961420 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525a2d3-493b-4a9d-93ba-aacbaaf1f88c None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:19.968030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:19.968935 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:19.969386 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:19.969678 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] PATH_INFO: `/v3/projects/f468fa471a374d799fbd5a54e239ed59` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:19.971082 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f468fa471a374d799fbd5a54e239ed59)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:19.973214 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:19.982779 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:20.086552 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f468fa471a374d799fbd5a54e239ed59', 'request_id': 'req-4d97c744-5931-41fb-993d-8c8fa3728ff2'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.092931 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f468fa471a374d799fbd5a54e239ed59', 'request_id': 'req-4d97c744-5931-41fb-993d-8c8fa3728ff2'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.157036 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f468fa471a374d799fbd5a54e239ed59', 'request_id': 'req-4d97c744-5931-41fb-993d-8c8fa3728ff2'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.168725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] The token cache is being invalidate because project f468fa471a374d799fbd5a54e239ed59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:20.169017 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.169666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.171228 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1413/2820] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:19 2022] DELETE /identity/v3/projects/f468fa471a374d799fbd5a54e239ed59 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:20.175313 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:20.185514 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27d20-1795-4ffc-b4e0-0d830896d893 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:20.218265 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:20.241706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:20.242574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:20.242862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:20.243142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] PATH_INFO: `/v3/users/0729b4c76df543d7907817c3498a2913` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:20.244321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0729b4c76df543d7907817c3498a2913)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:20.246392 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:20.429364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0729b4c76df543d7907817c3498a2913'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.502439 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0729b4c76df543d7907817c3498a2913'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.515631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0729b4c76df543d7907817c3498a2913'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.523132 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0729b4c76df543d7907817c3498a2913'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.523798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-25cb9717-e782-43a9-b871-bdedb8a42d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0729b4c76df543d7907817c3498a2913'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:20.529733 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1408/2821] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:20 2022] DELETE /identity/v3/users/0729b4c76df543d7907817c3498a2913 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:20.993669 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:20.995681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:21.010282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97c744-5931-41fb-993d-8c8fa3728ff2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:21.069928 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:21.070785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.071071 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.071349 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] PATH_INFO: `/v3/projects/dfe46479b78d4a5bab8ab27f65238a10` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.072641 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe46479b78d4a5bab8ab27f65238a10)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:21.074541 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:21.205303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe46479b78d4a5bab8ab27f65238a10', 'request_id': 'req-49a82dd0-f512-46bd-ae89-d377041cf5be'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:21.211801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe46479b78d4a5bab8ab27f65238a10', 'request_id': 'req-49a82dd0-f512-46bd-ae89-d377041cf5be'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:21.279572 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe46479b78d4a5bab8ab27f65238a10', 'request_id': 'req-49a82dd0-f512-46bd-ae89-d377041cf5be'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:21.290749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] The token cache is being invalidate because project dfe46479b78d4a5bab8ab27f65238a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:21.291040 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:21.291666 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-49a82dd0-f512-46bd-ae89-d377041cf5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:21.293268 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1414/2822] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:20 2022] DELETE /identity/v3/projects/dfe46479b78d4a5bab8ab27f65238a10 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:13:21.298084 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7a2f-ca6b-4f6c-94ba-a9df7feebf57 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.298585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7a2f-ca6b-4f6c-94ba-a9df7feebf57 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.298770 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed7a2f-ca6b-4f6c-94ba-a9df7feebf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.317890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-24ed7a2f-ca6b-4f6c-94ba-a9df7feebf57 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:21.319319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-24ed7a2f-ca6b-4f6c-94ba-a9df7feebf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:21.377805 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1409/2823] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:21.387066 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a398-3bb8-49a4-81e9-caaabc2adde5 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.387365 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a398-3bb8-49a4-81e9-caaabc2adde5 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.387650 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44a398-3bb8-49a4-81e9-caaabc2adde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.405799 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-de44a398-3bb8-49a4-81e9-caaabc2adde5 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:21.407001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-de44a398-3bb8-49a4-81e9-caaabc2adde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:21.415730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1415/2824] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:21.419835 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7a2f-ca6b-4f6c-94ba-a9df7feebf57 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:21.430206 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed7a2f-ca6b-4f6c-94ba-a9df7feebf57 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:21.434858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:21.435505 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.435789 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.436070 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.437216 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:13:21.437526 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:21.439119 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:21.451350 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1410/2825] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 02 14:13:21.455448 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a398-3bb8-49a4-81e9-caaabc2adde5 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:21.464670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44a398-3bb8-49a4-81e9-caaabc2adde5 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:21.469296 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:21.469941 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.470224 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.470504 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.471185 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:21.473118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:21.555384 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:21.563070 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1416/2826] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:21 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:21.567147 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:21.577069 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016eba9a-5474-47a2-a149-a43fb6911979 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:21.619211 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:21.634294 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:21.634963 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.635252 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.635532 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.636227 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:21.638249 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:21.739722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1411/2827] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:21 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:21.744159 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:21.755258 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5941c1-adfe-44b6-a7bf-282a6efb9658 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:21.760018 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:21.760736 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.761028 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.761341 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.762080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:21.763670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:21.774726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1417/2828] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:21.778808 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:21.789782 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f946d1-12a0-474f-b1f1-25ef77a86937 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:21.794526 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175dc465-be57-4644-b07f-8f2baf895e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:21.798151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dc465-be57-4644-b07f-8f2baf895e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.798151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dc465-be57-4644-b07f-8f2baf895e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.798151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175dc465-be57-4644-b07f-8f2baf895e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.798151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dc465-be57-4644-b07f-8f2baf895e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:21.798151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175dc465-be57-4644-b07f-8f2baf895e94 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:21.808585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1412/2829] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:21.812825 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:21.822604 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd4a1a-f320-479a-8a67-88e67c3fe83b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:21.827460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:21.828320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.828654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.828934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] PATH_INFO: `/v3/projects/37ff7689e8e24a1184bf29a6a36084f9/users/d64049da084940aa938eb4749f9036cd/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.843843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37ff7689e8e24a1184bf29a6a36084f9, user_id=d64049da084940aa938eb4749f9036cd, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:21.846516 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:21.930775 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1418/2830] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:21 2022] PUT /identity/v3/projects/37ff7689e8e24a1184bf29a6a36084f9/users/d64049da084940aa938eb4749f9036cd/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:21.941245 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d78e8-0ab4-4017-a437-da80d7b19744 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:21.941566 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d78e8-0ab4-4017-a437-da80d7b19744 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:21.941874 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d78e8-0ab4-4017-a437-da80d7b19744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:21.968564 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6b7d78e8-0ab4-4017-a437-da80d7b19744 None None] MFA Rules not processed for user `d64049da084940aa938eb4749f9036cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:21.969777 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6b7d78e8-0ab4-4017-a437-da80d7b19744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:22.034340 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1413/2831] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:22.038726 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:22.101284 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed2e75-b624-4439-91cf-6515044c3893 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:22.106027 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:22.106686 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:22.106974 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:22.107255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:22.107937 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:22.109852 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:22.227130 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1419/2832] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:22 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:22.231165 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d78e8-0ab4-4017-a437-da80d7b19744 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:22.242170 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d78e8-0ab4-4017-a437-da80d7b19744 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:22.299093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:22.300193 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:22.300567 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:22.300948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:22.301803 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:22.304081 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:22.492708 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1414/2833] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:22 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:22.496755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:22.507681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b0d81-f1ee-4c1c-a768-47bc4b691d24 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:22.512307 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:22.513007 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:22.513295 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:22.513574 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:22.514302 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:22.515899 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:22.526828 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1420/2834] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:22.531136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:22.542384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88635-5681-4aef-bf99-258ce849821b admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:22.546906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71be91-f366-49a8-b444-de5dfb00ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:22.547559 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71be91-f366-49a8-b444-de5dfb00ba61 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:22.547845 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71be91-f366-49a8-b444-de5dfb00ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:22.548125 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71be91-f366-49a8-b444-de5dfb00ba61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:22.548966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71be91-f366-49a8-b444-de5dfb00ba61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:22.550585 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71be91-f366-49a8-b444-de5dfb00ba61 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:22.560856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1415/2835] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:22.565172 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:22.575727 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6d8bb-28b5-45bd-bdaf-fbabcf000adb admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:22.580207 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:22.581112 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:22.581396 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:22.581675 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] PATH_INFO: `/v3/projects/76d4099f77a24a469580cf0b56920295/users/cb87564501114829b8f9d322dfb9cd74/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:22.596149 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d4099f77a24a469580cf0b56920295, user_id=cb87564501114829b8f9d322dfb9cd74, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:22.598868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:22.717912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1421/2836] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:22 2022] PUT /identity/v3/projects/76d4099f77a24a469580cf0b56920295/users/cb87564501114829b8f9d322dfb9cd74/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:13:22.729074 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f9f2-ecf3-4150-9b58-b93daba47e03 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:22.729406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f9f2-ecf3-4150-9b58-b93daba47e03 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:22.729691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7f9f2-ecf3-4150-9b58-b93daba47e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:22.767311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-39c7f9f2-ecf3-4150-9b58-b93daba47e03 None None] MFA Rules not processed for user `cb87564501114829b8f9d322dfb9cd74`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:22.767311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-39c7f9f2-ecf3-4150-9b58-b93daba47e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:22.780792 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:22.826817 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1416/2837] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:22.831334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:22.893143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbb8e5-2e60-4cfc-91f9-c69e755cabbe admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:22.898030 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:22.898783 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:22.899078 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:22.899358 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:22.900097 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:22.902140 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:23.055747 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:23.063170 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1422/2838] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:22 2022] POST /identity/v3/projects => generated 377 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:23.067357 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f9f2-ecf3-4150-9b58-b93daba47e03 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:23.078959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7f9f2-ecf3-4150-9b58-b93daba47e03 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:23.135492 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:23.136153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:23.136463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:23.136743 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:23.137426 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:23.139364 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:23.363494 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1417/2839] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:23 2022] POST /identity/v3/users => generated 295 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:23.367656 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:23.377724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391beb6-f62e-4336-8fee-a03fca92f9a2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:23.382568 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:23.383253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:23.383531 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:23.383810 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:23.384585 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:23.386157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:23.397613 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1423/2840] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:23.401681 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:23.411589 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ffcb-df7b-413e-8f53-2478104f8fcc admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:23.416775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:23.417640 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:23.417925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:23.418200 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] PATH_INFO: `/v3/projects/cdc963e860114dda8a2422d4fee6e83a/users/11c16987ff024a4db7c026e2d2322df3/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:23.432787 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc963e860114dda8a2422d4fee6e83a, user_id=11c16987ff024a4db7c026e2d2322df3, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:23.435440 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:23.505739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1418/2841] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:23 2022] PUT /identity/v3/projects/cdc963e860114dda8a2422d4fee6e83a/users/11c16987ff024a4db7c026e2d2322df3/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:23.510334 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:23.520527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8d85cc-b7fd-4e2a-b9ff-15ecc1be4766 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:23.577980 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93d890-6e67-4f77-a7a2-40aa69a54cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:23.578638 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93d890-6e67-4f77-a7a2-40aa69a54cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:23.578927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93d890-6e67-4f77-a7a2-40aa69a54cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:23.579204 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93d890-6e67-4f77-a7a2-40aa69a54cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:23.579922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93d890-6e67-4f77-a7a2-40aa69a54cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:23.581609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93d890-6e67-4f77-a7a2-40aa69a54cbc admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:23.592246 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1424/2842] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:23.596384 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:23.606525 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2f030-3396-4233-97e2-09b96d327c34 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:23.611407 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:23.612270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:23.612577 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:23.612869 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] PATH_INFO: `/v3/projects/cdc963e860114dda8a2422d4fee6e83a/users/11c16987ff024a4db7c026e2d2322df3/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:23.614865 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc963e860114dda8a2422d4fee6e83a, user_id=11c16987ff024a4db7c026e2d2322df3, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:23.617455 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:23.627319 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1419/2843] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:23 2022] PUT /identity/v3/projects/cdc963e860114dda8a2422d4fee6e83a/users/11c16987ff024a4db7c026e2d2322df3/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:23.687392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:23.687777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:23.688143 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:23.715460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] MFA Rules not processed for user `11c16987ff024a4db7c026e2d2322df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:23.717057 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:23.784323 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1425/2844] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:23.796383 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:23.798114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:23.856075 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68bcfb-b100-4cd5-ab41-d146802d8f86 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:23.859833 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:23.865946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:23.865946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:23.865946 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:23.870545 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:23.871990 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:23.882178 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1420/2845] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:24.027169 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:24.032811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:24.040934 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d2be5-1a1d-4165-9522-0b36afe8be18 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:24.044460 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7666112-7271-48bd-b439-62af9556d126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:24.045103 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666112-7271-48bd-b439-62af9556d126 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:24.045392 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666112-7271-48bd-b439-62af9556d126 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:24.045671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7666112-7271-48bd-b439-62af9556d126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:24.112916 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666112-7271-48bd-b439-62af9556d126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:24.114409 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7666112-7271-48bd-b439-62af9556d126 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:24.124433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1426/2846] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:29.287939 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:29.305616 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:29.349305 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864b8ce-e5a2-43ba-a58e-4ff41e2c9a2c service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:29.357864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:29.357864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:29.357864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:29.357864 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] PATH_INFO: `/v3/users/d64049da084940aa938eb4749f9036cd` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:29.358345 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64049da084940aa938eb4749f9036cd)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:29.358741 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:29.589312 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64049da084940aa938eb4749f9036cd'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:29.667368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64049da084940aa938eb4749f9036cd'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:29.679836 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64049da084940aa938eb4749f9036cd'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:29.686847 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64049da084940aa938eb4749f9036cd'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:29.687480 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64049da084940aa938eb4749f9036cd'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:29.693263 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1421/2847] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:29 2022] DELETE /identity/v3/users/d64049da084940aa938eb4749f9036cd => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:29.697855 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:29.698331 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:29.698470 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:29.710926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=100 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:29.717114 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:29.718325 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:29.777688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1427/2848] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:29.787821 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:29.789239 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:29.844484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5095f-4f9f-403b-9ff5-5e4d5c5667c3 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:29.848001 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:29.848663 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:29.848956 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:29.849220 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:29.858609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:29.860027 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:29.870129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1422/2849] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:30.278161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:30.281620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:30.294282 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc25f7a-a01e-4178-bd99-064fb479854d None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:30.298929 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:30.300177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:30.300177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:30.300580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] PATH_INFO: `/v3/projects/37ff7689e8e24a1184bf29a6a36084f9` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:30.301731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37ff7689e8e24a1184bf29a6a36084f9)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:30.304181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:30.416761 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37ff7689e8e24a1184bf29a6a36084f9', 'request_id': 'req-697b103f-e4ba-46bd-9aca-693c54dfc0d3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.422940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37ff7689e8e24a1184bf29a6a36084f9', 'request_id': 'req-697b103f-e4ba-46bd-9aca-693c54dfc0d3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.482318 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37ff7689e8e24a1184bf29a6a36084f9', 'request_id': 'req-697b103f-e4ba-46bd-9aca-693c54dfc0d3'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.494192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] The token cache is being invalidate because project 37ff7689e8e24a1184bf29a6a36084f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:30.494480 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.495166 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.496734 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1428/2850] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:30 2022] DELETE /identity/v3/projects/37ff7689e8e24a1184bf29a6a36084f9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:30.500794 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:30.511190 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ad6eff-38e5-43f0-8f80-895112118f40 service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:30.545066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:30.567116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:30.567974 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:30.568321 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:30.568686 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] PATH_INFO: `/v3/users/cb87564501114829b8f9d322dfb9cd74` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:30.570029 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb87564501114829b8f9d322dfb9cd74)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:30.571929 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:30.796925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb87564501114829b8f9d322dfb9cd74'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.879452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb87564501114829b8f9d322dfb9cd74'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.901826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb87564501114829b8f9d322dfb9cd74'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.908729 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb87564501114829b8f9d322dfb9cd74'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.909443 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb87564501114829b8f9d322dfb9cd74'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:30.916772 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1423/2851] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:30 2022] DELETE /identity/v3/users/cb87564501114829b8f9d322dfb9cd74 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:31.363901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:31.369699 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:31.379738 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697b103f-e4ba-46bd-9aca-693c54dfc0d3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:31.439608 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:31.440491 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:31.440785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:31.441063 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] PATH_INFO: `/v3/projects/76d4099f77a24a469580cf0b56920295` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:31.442230 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d4099f77a24a469580cf0b56920295)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:31.444811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:31.522187 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:31.545704 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d4099f77a24a469580cf0b56920295', 'request_id': 'req-18feb827-bc35-4d71-a979-79bf41783738'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:31.552081 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d4099f77a24a469580cf0b56920295', 'request_id': 'req-18feb827-bc35-4d71-a979-79bf41783738'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:31.617181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d4099f77a24a469580cf0b56920295', 'request_id': 'req-18feb827-bc35-4d71-a979-79bf41783738'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:31.628281 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] The token cache is being invalidate because project 76d4099f77a24a469580cf0b56920295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:31.628547 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:31.629178 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:31.630827 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1429/2852] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:31 2022] DELETE /identity/v3/projects/76d4099f77a24a469580cf0b56920295 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:31.635391 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:31.636878 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:31.649647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fad6c1-206a-4a63-a716-069f01d2dc94 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:31.706270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:31.707126 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:31.707441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:31.707723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] PATH_INFO: `/v3/users/11c16987ff024a4db7c026e2d2322df3` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:31.709010 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c16987ff024a4db7c026e2d2322df3)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:31.711390 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:31.916825 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c16987ff024a4db7c026e2d2322df3'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.021895 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c16987ff024a4db7c026e2d2322df3'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.026972 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:32.034950 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c16987ff024a4db7c026e2d2322df3'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.042201 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c16987ff024a4db7c026e2d2322df3'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.042856 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-b483d995-fc21-40db-a516-a92c1bd03d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c16987ff024a4db7c026e2d2322df3'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.048690 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1424/2853] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:31 2022] DELETE /identity/v3/users/11c16987ff024a4db7c026e2d2322df3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:32.463791 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:32.465301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:32.480610 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18feb827-bc35-4d71-a979-79bf41783738 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:32.540977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:32.541895 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:32.548072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:32.548072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] PATH_INFO: `/v3/projects/cdc963e860114dda8a2422d4fee6e83a` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:32.548072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc963e860114dda8a2422d4fee6e83a)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:32.548072 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:32.636335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc963e860114dda8a2422d4fee6e83a', 'request_id': 'req-2675d438-ea8a-42de-9945-98351a6f5b54'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.642730 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc963e860114dda8a2422d4fee6e83a', 'request_id': 'req-2675d438-ea8a-42de-9945-98351a6f5b54'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.722522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc963e860114dda8a2422d4fee6e83a', 'request_id': 'req-2675d438-ea8a-42de-9945-98351a6f5b54'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.734231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] The token cache is being invalidate because project cdc963e860114dda8a2422d4fee6e83a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:32.734523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.735206 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-2675d438-ea8a-42de-9945-98351a6f5b54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:32.736813 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1430/2854] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:32 2022] DELETE /identity/v3/projects/cdc963e860114dda8a2422d4fee6e83a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:32.743520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8bd7-4f77-4f0c-8675-c8e75746d2c7 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:32.744011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8bd7-4f77-4f0c-8675-c8e75746d2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:32.744011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb8bd7-4f77-4f0c-8675-c8e75746d2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:32.761356 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-86fb8bd7-4f77-4f0c-8675-c8e75746d2c7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:32.762553 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-86fb8bd7-4f77-4f0c-8675-c8e75746d2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:32.821151 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1425/2855] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 02 14:13:32.829301 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58765-b169-4b96-9b0e-310f71a0f36a None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:32.829605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58765-b169-4b96-9b0e-310f71a0f36a None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:32.829896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c58765-b169-4b96-9b0e-310f71a0f36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:32.848051 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-91c58765-b169-4b96-9b0e-310f71a0f36a None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:32.849303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-91c58765-b169-4b96-9b0e-310f71a0f36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:32.858174 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1431/2856] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:32.862615 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8bd7-4f77-4f0c-8675-c8e75746d2c7 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:32.872806 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb8bd7-4f77-4f0c-8675-c8e75746d2c7 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:32.877371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:32.878016 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:32.878301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:32.878573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:32.879286 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:13:32.879591 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:32.881466 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:32.892857 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1426/2857] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:13:32.897718 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58765-b169-4b96-9b0e-310f71a0f36a None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:32.909139 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c58765-b169-4b96-9b0e-310f71a0f36a None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:32.917677 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:32.918356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:32.918645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:32.918930 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:32.919671 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:32.921681 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.038749 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1432/2858] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:32 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:33.042896 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.053079 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d4a69-ac2a-417c-b816-d9acf76f89c4 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.110230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.110894 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.111182 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.111463 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.112141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.114121 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.239371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1427/2859] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:33 2022] POST /identity/v3/users => generated 291 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:33.243860 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.254645 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0cb5f-d621-4044-ba1e-f3a0e258dbeb admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.259933 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.260627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.260950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.261256 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.261990 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.263785 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.276052 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1433/2860] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:33.280283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.290779 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f7c21-7324-450f-8ea0-9715f3dba839 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.295510 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1bc88d-dbf2-401d-9049-490f31d44486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.296195 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc88d-dbf2-401d-9049-490f31d44486 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.296556 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc88d-dbf2-401d-9049-490f31d44486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.296964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1bc88d-dbf2-401d-9049-490f31d44486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.297693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bc88d-dbf2-401d-9049-490f31d44486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.299317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1bc88d-dbf2-401d-9049-490f31d44486 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.309658 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1428/2861] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:33.314059 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.324768 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95599bf-5874-4a41-8cb6-e46e2b6a4c5a admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.329336 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.330231 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.330521 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.330802 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] PATH_INFO: `/v3/projects/8e7956a444b74d5b8d5f51b637120505/users/f9397dded3de4ea88030746ad3ad3bec/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.339441 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:33.346080 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7956a444b74d5b8d5f51b637120505, user_id=f9397dded3de4ea88030746ad3ad3bec, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.348801 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.419450 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1434/2862] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:33 2022] PUT /identity/v3/projects/8e7956a444b74d5b8d5f51b637120505/users/f9397dded3de4ea88030746ad3ad3bec/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:33.433819 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991549f-26df-4b9c-8d68-f309d455f58e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.434116 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991549f-26df-4b9c-8d68-f309d455f58e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.434406 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991549f-26df-4b9c-8d68-f309d455f58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.462568 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-6991549f-26df-4b9c-8d68-f309d455f58e None None] MFA Rules not processed for user `f9397dded3de4ea88030746ad3ad3bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:33.463765 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-6991549f-26df-4b9c-8d68-f309d455f58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:33.495881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:33.531285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1429/2863] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:33.535820 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.598320 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbc40b-9f56-4541-aa68-2e312c9601c2 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.602994 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.603654 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.603944 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.604227 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.604952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.606897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.702952 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1435/2864] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:33 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 02 14:13:33.707073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991549f-26df-4b9c-8d68-f309d455f58e None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.718254 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991549f-26df-4b9c-8d68-f309d455f58e None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.775493 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.776142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.776460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.776742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.777430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.779344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.879055 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1430/2865] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:33 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:33.883527 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.893838 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5277560-9aea-4d8a-b2f4-9f721ff44d8b admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.898796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.899449 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.899731 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.900009 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.900796 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.902437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:33.912831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1436/2866] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:33.916852 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:33.926858 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702c1dd-c193-4ce0-bcb9-02c3972c9423 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:33.932099 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:33.935959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:33.935959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:33.935959 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] PATH_INFO: `/v3/projects/ccf2901ffba548cf82862261d98e5ad1/users/a097331a515842fe8952625218191eb4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:33.949387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf2901ffba548cf82862261d98e5ad1, user_id=a097331a515842fe8952625218191eb4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:33.952171 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:34.028307 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1431/2867] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:33 2022] PUT /identity/v3/projects/ccf2901ffba548cf82862261d98e5ad1/users/a097331a515842fe8952625218191eb4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:34.032124 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:34.043356 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68678-3649-4f39-9ad9-66a31bb17cce admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:34.101849 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f65443-987e-47bd-a949-02d3931c8e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:34.102519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65443-987e-47bd-a949-02d3931c8e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:34.102815 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65443-987e-47bd-a949-02d3931c8e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:34.103125 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f65443-987e-47bd-a949-02d3931c8e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:34.103892 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f65443-987e-47bd-a949-02d3931c8e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:34.105520 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f65443-987e-47bd-a949-02d3931c8e66 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:34.115963 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1437/2868] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:34.120108 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:34.130370 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5182bf2-eb31-4440-b295-160a46249c70 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:34.134966 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:34.135831 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:34.136117 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:34.136435 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] PATH_INFO: `/v3/projects/ccf2901ffba548cf82862261d98e5ad1/users/a097331a515842fe8952625218191eb4/roles/add60904ef824ad3b92149e0f251f55c` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:34.138371 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf2901ffba548cf82862261d98e5ad1, user_id=a097331a515842fe8952625218191eb4, role_id=add60904ef824ad3b92149e0f251f55c)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:34.141024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:34.151727 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1432/2869] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:34 2022] PUT /identity/v3/projects/ccf2901ffba548cf82862261d98e5ad1/users/a097331a515842fe8952625218191eb4/roles/add60904ef824ad3b92149e0f251f55c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:34.161597 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038015-f0cb-4a6e-9cc8-289ba41c2a3b None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:34.162442 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038015-f0cb-4a6e-9cc8-289ba41c2a3b None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:34.162753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038015-f0cb-4a6e-9cc8-289ba41c2a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:34.189446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-f9038015-f0cb-4a6e-9cc8-289ba41c2a3b None None] MFA Rules not processed for user `a097331a515842fe8952625218191eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:34.190658 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-f9038015-f0cb-4a6e-9cc8-289ba41c2a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:34.235269 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:34.259477 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1438/2870] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:34 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:34.274742 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:34.276430 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:34.334571 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634e95e-c0d6-4f34-a380-d5acd13e6950 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:34.338159 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:34.338786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:34.339067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:34.339344 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:34.348790 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:34.351810 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:34.360011 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1433/2871] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:34.481193 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038015-f0cb-4a6e-9cc8-289ba41c2a3b None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:34.491034 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038015-f0cb-4a6e-9cc8-289ba41c2a3b None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:34.496053 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3c3aa-8c6c-43a2-8334-e241d31304fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:34.497304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3c3aa-8c6c-43a2-8334-e241d31304fd service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:34.499743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3c3aa-8c6c-43a2-8334-e241d31304fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:34.499743 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3c3aa-8c6c-43a2-8334-e241d31304fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:34.558724 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3c3aa-8c6c-43a2-8334-e241d31304fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:34.560160 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3c3aa-8c6c-43a2-8334-e241d31304fd service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:34.569180 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1439/2872] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:35.153911 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:35.183072 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:35.215964 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa38eec-91e8-4690-810b-934282b7c6c1 service cinder] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:35.220675 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:35.221539 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:35.221824 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:35.222101 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] PATH_INFO: `/v3/users/f9397dded3de4ea88030746ad3ad3bec` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:35.223380 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9397dded3de4ea88030746ad3ad3bec)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:35.225698 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:35.456561 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9397dded3de4ea88030746ad3ad3bec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:35.533628 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9397dded3de4ea88030746ad3ad3bec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:35.548394 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9397dded3de4ea88030746ad3ad3bec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:35.556089 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9397dded3de4ea88030746ad3ad3bec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:35.556764 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9397dded3de4ea88030746ad3ad3bec'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:35.563102 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1434/2873] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:35 2022] DELETE /identity/v3/users/f9397dded3de4ea88030746ad3ad3bec => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:35.567605 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:35.568083 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:35.568189 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:35.585181 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:35.586366 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:35.643901 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1440/2874] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:35.653379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:35.654781 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:35.712945 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af9f8f-ae24-4adc-bea9-3af6d9035282 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:35.716484 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:35.717129 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:35.717413 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:35.717693 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:35.727613 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:35.729087 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:35.738349 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1435/2875] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:13:36.196192 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:36.200252 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:36.212218 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ce4db-61da-4248-84b3-18911f6f4620 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:36.217523 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:36.218691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:36.218977 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:36.219262 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] PATH_INFO: `/v3/projects/8e7956a444b74d5b8d5f51b637120505` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:36.223756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7956a444b74d5b8d5f51b637120505)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:36.223756 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:36.377337 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7956a444b74d5b8d5f51b637120505', 'request_id': 'req-d271f89c-db97-4f5b-ab4f-c02b6a552495'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.383335 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7956a444b74d5b8d5f51b637120505', 'request_id': 'req-d271f89c-db97-4f5b-ab4f-c02b6a552495'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.459291 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7956a444b74d5b8d5f51b637120505', 'request_id': 'req-d271f89c-db97-4f5b-ab4f-c02b6a552495'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.470662 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] The token cache is being invalidate because project 8e7956a444b74d5b8d5f51b637120505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:36.470956 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.471592 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.473229 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1441/2876] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:36 2022] DELETE /identity/v3/projects/8e7956a444b74d5b8d5f51b637120505 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:36.478706 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:36.488826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9f40cc-61f1-4318-99a3-992ebf49274c service neutron] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:36.538722 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:36.550735 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:36.551598 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:36.551881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:36.552158 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] PATH_INFO: `/v3/users/a097331a515842fe8952625218191eb4` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:36.553441 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a097331a515842fe8952625218191eb4)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:36.556183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:36.740368 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a097331a515842fe8952625218191eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.830691 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a097331a515842fe8952625218191eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.843527 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a097331a515842fe8952625218191eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.850961 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a097331a515842fe8952625218191eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.851619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-1d87bda1-70c8-48f3-9663-276332f98226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a097331a515842fe8952625218191eb4'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:36.857524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1436/2877] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:36 2022] DELETE /identity/v3/users/a097331a515842fe8952625218191eb4 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:37.266380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:37.267957 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:37.280719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:37.284729 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f89c-db97-4f5b-ab4f-c02b6a552495 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:37.345912 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:37.346776 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:37.347064 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:37.347345 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] PATH_INFO: `/v3/projects/ccf2901ffba548cf82862261d98e5ad1` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:37.348578 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf2901ffba548cf82862261d98e5ad1)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:37.350532 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:37.449223 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf2901ffba548cf82862261d98e5ad1', 'request_id': 'req-f87c79eb-3463-4c4e-b158-cb6f0645039e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:37.455310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf2901ffba548cf82862261d98e5ad1', 'request_id': 'req-f87c79eb-3463-4c4e-b158-cb6f0645039e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:37.516968 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf2901ffba548cf82862261d98e5ad1', 'request_id': 'req-f87c79eb-3463-4c4e-b158-cb6f0645039e'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:37.528640 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] The token cache is being invalidate because project ccf2901ffba548cf82862261d98e5ad1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:37.528866 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:37.529505 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-f87c79eb-3463-4c4e-b158-cb6f0645039e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:37.531079 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1442/2878] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:37 2022] DELETE /identity/v3/projects/ccf2901ffba548cf82862261d98e5ad1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:37.535998 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d417bc-5e84-4704-a363-428bf6b31ec0 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:37.536516 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d417bc-5e84-4704-a363-428bf6b31ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:37.536636 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d417bc-5e84-4704-a363-428bf6b31ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:37.555464 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-74d417bc-5e84-4704-a363-428bf6b31ec0 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:37.556711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-74d417bc-5e84-4704-a363-428bf6b31ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:37.615149 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1437/2879] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:37.623138 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba686-e3f7-464d-9e17-70a4da02f956 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:37.623433 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba686-e3f7-464d-9e17-70a4da02f956 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:37.623715 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ba686-e3f7-464d-9e17-70a4da02f956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:37.643075 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-929ba686-e3f7-464d-9e17-70a4da02f956 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:37.644247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-929ba686-e3f7-464d-9e17-70a4da02f956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:37.652073 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1443/2880] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:37.656067 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d417bc-5e84-4704-a363-428bf6b31ec0 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:37.665780 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d417bc-5e84-4704-a363-428bf6b31ec0 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:37.670533 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:37.671179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:37.671460 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:37.671739 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:37.672519 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:13:37.672826 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:37.674447 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:37.686462 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1438/2881] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:13:37.690612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba686-e3f7-464d-9e17-70a4da02f956 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:37.700426 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ba686-e3f7-464d-9e17-70a4da02f956 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:37.705095 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:37.705735 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:37.706023 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:37.706304 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:37.706992 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:37.708919 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:37.841276 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1444/2882] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:37 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:37.845513 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:37.856707 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc0004-6942-4b3b-ace3-9771f9580df6 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:37.905631 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:37.912387 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:37.913771 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:37.914183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:37.914469 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:37.915154 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:37.917179 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:38.010311 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1439/2883] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:37 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:38.014539 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:38.025195 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4157f18-d138-4b4e-9e65-7aba1de0e243 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:38.029950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:38.030611 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:38.030917 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:38.031177 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:38.031936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:38.033558 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:38.044670 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1445/2884] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:38.048753 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:38.059661 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d5e5c-799f-4a71-8a03-f677d72eed1a admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:38.065051 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa216127-b07b-464e-aa54-dedf45441459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:38.065711 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216127-b07b-464e-aa54-dedf45441459 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:38.066004 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216127-b07b-464e-aa54-dedf45441459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:38.066289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa216127-b07b-464e-aa54-dedf45441459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:38.067017 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa216127-b07b-464e-aa54-dedf45441459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:38.068669 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa216127-b07b-464e-aa54-dedf45441459 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:38.078759 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1440/2885] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 02 14:13:38.082672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:38.092926 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e7479-eae8-4a36-93b1-9240ccea4e6d admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:38.097446 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:38.098308 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:38.098595 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:38.098874 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] PATH_INFO: `/v3/projects/9e1dcd14139c41ad832c18a737b864c5/users/6cbda653bac644c2abdbd18c2bd93f73/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:38.127638 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1dcd14139c41ad832c18a737b864c5, user_id=6cbda653bac644c2abdbd18c2bd93f73, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:38.130380 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:38.234927 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1446/2886] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:38 2022] PUT /identity/v3/projects/9e1dcd14139c41ad832c18a737b864c5/users/6cbda653bac644c2abdbd18c2bd93f73/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:38.246210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814dda0-26e2-4ad2-acf8-c36c7e307479 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:38.246502 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814dda0-26e2-4ad2-acf8-c36c7e307479 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:38.246783 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814dda0-26e2-4ad2-acf8-c36c7e307479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:38.273576 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-c814dda0-26e2-4ad2-acf8-c36c7e307479 None None] MFA Rules not processed for user `6cbda653bac644c2abdbd18c2bd93f73`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:38.274812 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-c814dda0-26e2-4ad2-acf8-c36c7e307479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:38.339253 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1441/2887] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:38.349883 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:38.352311 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:38.386936 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:38.409347 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7359b-ca64-451a-9cc1-25cdacd7e81e admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:38.413021 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ace6-f632-4ff7-a0ee-643228bf2da8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:38.413709 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ace6-f632-4ff7-a0ee-643228bf2da8 service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:38.413995 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ace6-f632-4ff7-a0ee-643228bf2da8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:38.414273 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ace6-f632-4ff7-a0ee-643228bf2da8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:38.422808 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837ace6-f632-4ff7-a0ee-643228bf2da8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:38.424255 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837ace6-f632-4ff7-a0ee-643228bf2da8 service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:38.433950 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1447/2888] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:43.512215 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814dda0-26e2-4ad2-acf8-c36c7e307479 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:43.573775 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814dda0-26e2-4ad2-acf8-c36c7e307479 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:43.578306 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:43.579163 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:43.579448 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:43.579726 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] PATH_INFO: `/v3/users/6cbda653bac644c2abdbd18c2bd93f73` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:43.580921 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbda653bac644c2abdbd18c2bd93f73)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:43.582851 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:43.766862 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbda653bac644c2abdbd18c2bd93f73'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:43.838531 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbda653bac644c2abdbd18c2bd93f73'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:43.846853 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:43.851362 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbda653bac644c2abdbd18c2bd93f73'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:43.858379 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbda653bac644c2abdbd18c2bd93f73'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:43.859025 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbda653bac644c2abdbd18c2bd93f73'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:43.864941 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1442/2889] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:13:43 2022] DELETE /identity/v3/users/6cbda653bac644c2abdbd18c2bd93f73 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:43.870131 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:43.870672 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:43.871253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:43.891266 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:43.892519 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:43.954001 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1448/2890] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:43.964414 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:43.968093 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:44.023323 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca20a9-6962-40b7-a483-216b71b04e08 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:44.027536 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9913daa-00fb-4e04-8d1c-0b6ab99c67be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:44.028172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913daa-00fb-4e04-8d1c-0b6ab99c67be service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:44.028500 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913daa-00fb-4e04-8d1c-0b6ab99c67be service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:44.028784 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9913daa-00fb-4e04-8d1c-0b6ab99c67be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:44.037890 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9913daa-00fb-4e04-8d1c-0b6ab99c67be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:44.039405 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9913daa-00fb-4e04-8d1c-0b6ab99c67be service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:44.049024 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1443/2891] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:44.450090 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:44.454437 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:44.463612 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c4e0f-c1eb-4d1c-916e-6d08e53825f2 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:44.468599 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:44.469465 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:44.469755 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:44.470038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] PATH_INFO: `/v3/projects/9e1dcd14139c41ad832c18a737b864c5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:44.471316 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1dcd14139c41ad832c18a737b864c5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:44.473362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:44.587220 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1dcd14139c41ad832c18a737b864c5', 'request_id': 'req-5521ce98-7698-4eb5-ad82-0ceea57890bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:44.593303 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1dcd14139c41ad832c18a737b864c5', 'request_id': 'req-5521ce98-7698-4eb5-ad82-0ceea57890bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:44.687744 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1dcd14139c41ad832c18a737b864c5', 'request_id': 'req-5521ce98-7698-4eb5-ad82-0ceea57890bf'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:44.698868 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] The token cache is being invalidate because project 9e1dcd14139c41ad832c18a737b864c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80597) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:13:44.699161 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:44.699793 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-5521ce98-7698-4eb5-ad82-0ceea57890bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:13:44.701370 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1449/2892] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:13:44 2022] DELETE /identity/v3/projects/9e1dcd14139c41ad832c18a737b864c5 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:44.706234 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad6959-0d35-4a6c-a4ed-796336f0e58b None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:44.706719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad6959-0d35-4a6c-a4ed-796336f0e58b None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:44.706840 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad6959-0d35-4a6c-a4ed-796336f0e58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:44.724285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-d4ad6959-0d35-4a6c-a4ed-796336f0e58b None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:44.725524 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-d4ad6959-0d35-4a6c-a4ed-796336f0e58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:44.786366 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1444/2893] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:44.794106 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441b09-5dc8-473d-b3a3-9e95b5a5d8c4 None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:44.794403 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441b09-5dc8-473d-b3a3-9e95b5a5d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:44.794688 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e441b09-5dc8-473d-b3a3-9e95b5a5d8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:44.813537 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-5e441b09-5dc8-473d-b3a3-9e95b5a5d8c4 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:44.814739 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-5e441b09-5dc8-473d-b3a3-9e95b5a5d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:44.823208 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1450/2894] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:44.827289 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad6959-0d35-4a6c-a4ed-796336f0e58b None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:44.837090 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad6959-0d35-4a6c-a4ed-796336f0e58b None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:44.841715 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:44.842295 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:44.842575 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:44.842849 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:44.843584 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80598) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 02 14:13:44.843888 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:44.845506 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:44.856922 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1445/2895] 10.222.0.33 () {58 vars in 1152 bytes} [Thu Jun 2 14:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 02 14:13:44.861196 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441b09-5dc8-473d-b3a3-9e95b5a5d8c4 None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:44.871038 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e441b09-5dc8-473d-b3a3-9e95b5a5d8c4 None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:44.875760 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:44.876424 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:44.876719 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:44.877003 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:44.877691 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:44.879589 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:44.980369 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1451/2896] 10.222.0.33 () {60 vars in 1152 bytes} [Thu Jun 2 14:13:44 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:44.984696 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:44.995744 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48f64-4627-4365-a004-6b7832fb9a65 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:45.050411 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:45.051066 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:45.051347 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:45.051622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:45.052359 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:45.054230 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:45.156507 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1446/2897] 10.222.0.33 () {60 vars in 1143 bytes} [Thu Jun 2 14:13:44 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 02 14:13:45.160614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:45.171116 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7fb5de-5489-4375-988c-a477dd67f114 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:45.175789 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:45.176493 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:45.176784 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:45.177068 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] PATH_INFO: `/v3/roles` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:45.177898 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:45.179503 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:45.190945 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1452/2898] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:45.194884 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:45.200897 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:45.206198 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb7a9f-967a-4c2f-bb81-ef1dc74a78e5 admin admin] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:45.210809 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f476a3c-a7e5-47b7-8a05-8a62e1a58611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:45.211912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476a3c-a7e5-47b7-8a05-8a62e1a58611 admin admin] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:45.211912 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476a3c-a7e5-47b7-8a05-8a62e1a58611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:45.212142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f476a3c-a7e5-47b7-8a05-8a62e1a58611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:45.212850 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f476a3c-a7e5-47b7-8a05-8a62e1a58611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:45.214442 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f476a3c-a7e5-47b7-8a05-8a62e1a58611 admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:45.225952 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1447/2899] 10.222.0.33 () {58 vars in 1121 bytes} [Thu Jun 2 14:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 02 14:13:45.236626 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:45.247580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62185511-03eb-4277-9fd2-bfa0b13ecdee admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:45.252286 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:45.253306 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:45.253614 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:45.253896 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] PATH_INFO: `/v3/projects/5bbed82f914e4cf0a0b569dca408965b/users/a5657d98a640416d8dc56291dfd77ad5/roles/2dc928944ffa4e8fb7fe21c9dad9fe57` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:45.268814 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bbed82f914e4cf0a0b569dca408965b, user_id=a5657d98a640416d8dc56291dfd77ad5, role_id=2dc928944ffa4e8fb7fe21c9dad9fe57)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:45.271528 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:45.273697 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:13:45.351062 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1453/2900] 10.222.0.33 () {60 vars in 1482 bytes} [Thu Jun 2 14:13:45 2022] PUT /identity/v3/projects/5bbed82f914e4cf0a0b569dca408965b/users/a5657d98a640416d8dc56291dfd77ad5/roles/2dc928944ffa4e8fb7fe21c9dad9fe57 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:13:45.356982 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87046f06-926e-46ab-bdb2-2390b8142ed7 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:45.357301 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87046f06-926e-46ab-bdb2-2390b8142ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:45.357570 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87046f06-926e-46ab-bdb2-2390b8142ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:45.375774 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-87046f06-926e-46ab-bdb2-2390b8142ed7 None None] MFA Rules not processed for user `00880a086dd1493eb2030208d4b8d370`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:45.377023 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-87046f06-926e-46ab-bdb2-2390b8142ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:45.435285 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1448/2901] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:45.445020 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:45.447694 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:45.505119 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46fd42-6a04-4bbd-852b-451b2b81e025 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:45.509411 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:45.510077 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:45.510362 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:45.510667 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:45.519653 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:45.521129 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:45.530746 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1454/2902] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:46.810172 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4007e-e9ff-4b11-b78a-80f91834430e None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:46.810725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4007e-e9ff-4b11-b78a-80f91834430e None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:46.810725 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4007e-e9ff-4b11-b78a-80f91834430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:46.838376 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-18d4007e-e9ff-4b11-b78a-80f91834430e None None] MFA Rules not processed for user `a5657d98a640416d8dc56291dfd77ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:46.839622 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-18d4007e-e9ff-4b11-b78a-80f91834430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:46.912798 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1449/2903] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:46.924417 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:46.925884 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:46.985015 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10722949-47b2-4f58-810d-0749d67a29c0 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:46.988609 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b20a4dea241b4c299fb947b946464ea4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:46.989247 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:46.989533 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:46.989811 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:46.998997 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:47.000453 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:47.009711 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1455/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:49.776643 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:49.777183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:49.777183 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:49.795113 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] MFA Rules not processed for user `a5657d98a640416d8dc56291dfd77ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:13:49.796297 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:49.803053 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1450/2905] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:13:50.035897 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:50.037452 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:50.049981 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba00e95-c0ff-49c3-8d70-842da886af8d service cinder] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:50.053571 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e802d-68ea-49f1-a915-ce0822593f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:50.054210 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e802d-68ea-49f1-a915-ce0822593f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:50.054498 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e802d-68ea-49f1-a915-ce0822593f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:50.054780 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e802d-68ea-49f1-a915-ce0822593f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:50.057458 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-e55e802d-68ea-49f1-a915-ce0822593f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:50.067122 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e802d-68ea-49f1-a915-ce0822593f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:50.068580 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e802d-68ea-49f1-a915-ce0822593f27 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:50.076633 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1456/2906] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:13:50.475710 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:13:50.478632 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:50.557960 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e02ab3-22cd-4c8a-bc1f-a766b8fad179 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:13:50.563142 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:13:50.563786 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:13:50.564073 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:13:50.564355 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:13:50.566153 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:13:50.578333 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:13:50.579906 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:13:50.590534 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1451/2907] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:14:00.073121 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:INSERT=1,keystone:SELECT=60 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:00.585606 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=98 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:08.003141 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da85d1e-4278-498a-a631-958060c6bcaa None None] REQUEST_METHOD: `POST` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:08.003647 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da85d1e-4278-498a-a631-958060c6bcaa None None] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:08.003777 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da85d1e-4278-498a-a631-958060c6bcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:08.021041 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.auth.core [None req-9da85d1e-4278-498a-a631-958060c6bcaa None None] MFA Rules not processed for user `a5657d98a640416d8dc56291dfd77ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=80597) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:08.022259 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-9da85d1e-4278-498a-a631-958060c6bcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:08.029725 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1457/2908] 10.222.0.33 () {58 vars in 957 bytes} [Thu Jun 2 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:10.837304 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:10.848283 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206756b5-341e-401e-a232-13a04dcfd811 service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:10.851892 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032c544-cc91-41d4-98f3-82c0d66fb8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:10.852574 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032c544-cc91-41d4-98f3-82c0d66fb8fb service neutron] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:10.852861 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032c544-cc91-41d4-98f3-82c0d66fb8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:10.853141 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032c544-cc91-41d4-98f3-82c0d66fb8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:10.854958 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-5032c544-cc91-41d4-98f3-82c0d66fb8fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:10.929044 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032c544-cc91-41d4-98f3-82c0d66fb8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:10.930520 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032c544-cc91-41d4-98f3-82c0d66fb8fb service neutron] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:10.943719 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1452/2909] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:14:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 02 14:14:12.055226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da85d1e-4278-498a-a631-958060c6bcaa None None] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:12.065508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da85d1e-4278-498a-a631-958060c6bcaa None None] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:12.069583 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7b2b76c46b640c0b19b46ed50d333ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:12.070234 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:12.070529 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:12.070816 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:12.072751 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:12.087148 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:12.088617 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:12.101955 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1458/2910] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:14:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:14:20.938300 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=34 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:22.095765 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=9 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:34.025933 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d711-ea50-4bd9-8bef-8046fc3d6bef None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:34.026491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d711-ea50-4bd9-8bef-8046fc3d6bef None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:34.026491 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d711-ea50-4bd9-8bef-8046fc3d6bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:34.084609 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-36c6d711-ea50-4bd9-8bef-8046fc3d6bef None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:34.085723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-36c6d711-ea50-4bd9-8bef-8046fc3d6bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:34.147128 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1453/2911] 10.222.0.33 () {58 vars in 1009 bytes} [Thu Jun 2 14:14:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:34.275698 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:34.277226 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:34.367627 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e15bd-b646-4305-92a9-ad11ecbb6721 service neutron] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:34.372620 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:34.373261 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:34.373549 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:34.373831 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:34.382508 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:34.384133 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:34.392903 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1459/2912] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 14:14:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:14:44.144298 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=44 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:44.389118 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=41 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:14:51.286723 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] REQUEST_METHOD: `POST` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.287210 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.287317 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.305114 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.auth.core [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] MFA Rules not processed for user `6d3513ec025a448cad13fead94966aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80598) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 02 14:14:51.309214 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:51.314548 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1454/2913] 10.222.0.33 () {58 vars in 967 bytes} [Thu Jun 2 14:14:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 02 14:14:51.326389 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:51.336998 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440a5e7-c8fe-43fa-93c6-16844a16f8ed service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:51.344881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4599a196029c4f73b8428250cc19f8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:51.344881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:51.344881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:51.344881 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:51.351294 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:51.352902 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:51.361661 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1460/2914] 10.222.0.33 () {60 vars in 1384 bytes} [Thu Jun 2 14:14:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 02 14:14:54.197593 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:54.199094 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:54.214925 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e3365-7e78-4c68-8bfb-e80861b3ea45 None None] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:54.221296 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:54.221573 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] REQUEST_METHOD: `GET` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.221816 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.222112 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.223943 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.fernet_utils [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80598) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:14:54.236209 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:54.243664 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:54.247948 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1455/2915] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:14:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:14:54.340809 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:54.352312 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f050f-e660-42dc-928d-b5339da1453e service swift] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:54.361162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:54.361162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:54.361162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:54.361162 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] PATH_INFO: `/v3/users/a5657d98a640416d8dc56291dfd77ad5` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:54.362176 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5657d98a640416d8dc56291dfd77ad5)` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:54.362429 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:54.799310 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5657d98a640416d8dc56291dfd77ad5'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:54.882800 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5657d98a640416d8dc56291dfd77ad5'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:54.900157 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5657d98a640416d8dc56291dfd77ad5'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:54.909570 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5657d98a640416d8dc56291dfd77ad5'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:54.910359 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.notifications [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5657d98a640416d8dc56291dfd77ad5'} {{(pid=80597) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:54.921714 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1461/2916] 10.222.0.33 () {58 vars in 1223 bytes} [Thu Jun 2 14:14:54 2022] DELETE /identity/v3/users/a5657d98a640416d8dc56291dfd77ad5 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 02 14:14:55.192689 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] Authenticating user token {{(pid=80598) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:14:55.207012 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d716b-1453-43ca-b83c-fae622bd395f service placement] Validating token access rules against request {{(pid=80598) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:14:55.269022 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00880a086dd1493eb2030208d4b8d370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aedab9ecfa9f4a4fb3686cc6fffd6442', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80598) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:14:55.269881 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:14:55.270173 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] SCRIPT_NAME: `/identity` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:14:55.270452 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] PATH_INFO: `/v3/projects/5bbed82f914e4cf0a0b569dca408965b` {{(pid=80598) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:14:55.271633 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bbed82f914e4cf0a0b569dca408965b)` {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:14:55.273619 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] RBAC: Authorization granted {{(pid=80598) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:14:55.453647 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bbed82f914e4cf0a0b569dca408965b', 'request_id': 'req-685ba35a-1b4f-484b-9f52-95e9aace955d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:55.460189 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bbed82f914e4cf0a0b569dca408965b', 'request_id': 'req-685ba35a-1b4f-484b-9f52-95e9aace955d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:55.543136 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bbed82f914e4cf0a0b569dca408965b', 'request_id': 'req-685ba35a-1b4f-484b-9f52-95e9aace955d'} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:55.554644 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] The token cache is being invalidate because project 5bbed82f914e4cf0a0b569dca408965b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80598) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 02 14:14:55.554930 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:55.555665 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG keystone.notifications [None req-685ba35a-1b4f-484b-9f52-95e9aace955d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80598) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 02 14:14:55.557270 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: [pid: 80598|app: 0|req: 1456/2917] 10.222.0.33 () {58 vars in 1232 bytes} [Thu Jun 2 14:14:55 2022] DELETE /identity/v3/projects/5bbed82f914e4cf0a0b569dca408965b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 02 14:15:04.916843 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:15:05.551398 dv-cinder-826510-6-iscsi devstack@keystone.service[80598]: DEBUG dbcounter [-] [80598] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 02 14:17:08.992522 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Authenticating user token {{(pid=80597) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 02 14:17:08.993940 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:17:09.150922 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb088d-7f02-4945-a288-6d6e67197ea3 admin admin] Validating token access rules against request {{(pid=80597) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 02 14:17:09.208753 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149ae255-4308-403e-aaf7-02dafc595364 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4c0df21b3954b5d9dffd54643125817', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51230e971b9b4f1fa066c75c70521656', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80597) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 02 14:17:09.209401 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae255-4308-403e-aaf7-02dafc595364 service placement] REQUEST_METHOD: `GET` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 02 14:17:09.209690 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae255-4308-403e-aaf7-02dafc595364 service placement] SCRIPT_NAME: `/identity` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 02 14:17:09.209971 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149ae255-4308-403e-aaf7-02dafc595364 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80597) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 02 14:17:09.211766 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.fernet_utils [None req-149ae255-4308-403e-aaf7-02dafc595364 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80597) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 02 14:17:09.222921 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ae255-4308-403e-aaf7-02dafc595364 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 02 14:17:09.224872 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149ae255-4308-403e-aaf7-02dafc595364 service placement] RBAC: Authorization granted {{(pid=80597) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 02 14:17:09.235253 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: [pid: 80597|app: 0|req: 1462/2918] 10.222.0.33 () {60 vars in 1365 bytes} [Thu Jun 2 14:17:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 02 14:17:19.230923 dv-cinder-826510-6-iscsi devstack@keystone.service[80597]: DEBUG dbcounter [-] [80597] Writing DB stats keystone:SELECT=89 {{(pid=80597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}